[==========] Running 56 tests from 4 test suites.
[----------] Global test environment set-up.
[----------] 30 tests from SecurityITest
[ RUN ] SecurityITest.TestAuthorizationOnListTablets
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:47:53 dist-test-slave-2p8l krb5kdc[12918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:47:53 dist-test-slave-2p8l krb5kdc[12918](info): set up 2 sockets
Aug 07 19:47:53 dist-test-slave-2p8l krb5kdc[12918](info): commencing operation
krb5kdc: starting...
WARNING: Logging before InitGoogleLogging() is written to STDERR
W20260807 19:47:54.936692 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.424s user 0.007s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:47:55 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:47:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:47:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:47:55.191809 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:41273
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:41273
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:47:55.682037 12934 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:47:55.682523 12934 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:47:55.682762 12934 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:47:55.691830 12934 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:47:55.692009 12934 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:47:55.692137 12934 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:47:55.692288 12934 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:47:55.692387 12934 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:47:55.705014 12934 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:41273
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:41273
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:47:55.707525 12934 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:47:55.709882 12934 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:47:55.727159 12945 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:55.727186 12944 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:55.727069 12947 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:47:55.728029 12934 server_base.cc:1034] running on GCE node
I20260807 19:47:55.729059 12934 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:47:55.731070 12934 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:47:55.732414 12934 hybrid_clock.cc:648] HybridClock initialized: now 1786132075732253 us; error 75 us; skew 500 ppm
I20260807 19:47:55.732993 12934 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:47:55 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132075, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:47:55.737428 12934 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:47:55.739828 12934 webserver.cc:460] Webserver started at http://127.12.155.190:46635/ using document root <none> and password file <none>
I20260807 19:47:55.741071 12934 fs_manager.cc:359] Metadata directory not provided
I20260807 19:47:55.741254 12934 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:47:55.741750 12934 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:47:55.746040 12934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "0ef739fbc5384b2080f75908cc5c04a2"
format_stamp: "Formatted at 2026-08-07 19:47:55 on dist-test-slave-2p8l"
server_key: "2c2e4c6812171c5aeb17b124cb741443"
server_key_iv: "eafee7f46efdcf3e3baa3beb1d3215ce"
server_key_version: "encryptionkey@0"
I20260807 19:47:55.747087 12934 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "0ef739fbc5384b2080f75908cc5c04a2"
format_stamp: "Formatted at 2026-08-07 19:47:55 on dist-test-slave-2p8l"
server_key: "2c2e4c6812171c5aeb17b124cb741443"
server_key_iv: "eafee7f46efdcf3e3baa3beb1d3215ce"
server_key_version: "encryptionkey@0"
I20260807 19:47:55.754724 12934 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 19:47:55.759577 12955 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:55.761488 12934 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:47:55.761761 12934 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "0ef739fbc5384b2080f75908cc5c04a2"
format_stamp: "Formatted at 2026-08-07 19:47:55 on dist-test-slave-2p8l"
server_key: "2c2e4c6812171c5aeb17b124cb741443"
server_key_iv: "eafee7f46efdcf3e3baa3beb1d3215ce"
server_key_version: "encryptionkey@0"
I20260807 19:47:55.762117 12934 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:47:55.776770 12934 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:47:55.782922 12934 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:47:55.783403 12934 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:47:55.812739 12934 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:41273
I20260807 19:47:55.812739 13042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:41273 every 8 connection(s)
I20260807 19:47:55.815090 12934 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:47:55.820977 13043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:47:55.821241 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 12934
I20260807 19:47:55.821811 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:47:55.824406 12910 external_mini_cluster.cc:1428] Setting key 06046642383d3670c13d9b0ee15e3e69
I20260807 19:47:55.835852 13043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2: Bootstrap starting.
I20260807 19:47:55.839816 13043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2: Neither blocks nor log segments found. Creating new log.
I20260807 19:47:55.841445 13043 log.cc:824] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2: Log is configured to *not* fsync() on all Append() calls
I20260807 19:47:55.845705 13043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2: No bootstrap required, opened a new log
I20260807 19:47:55.855149 13043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef739fbc5384b2080f75908cc5c04a2" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41273 } }
I20260807 19:47:55.855690 13043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:47:55.855870 13043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0ef739fbc5384b2080f75908cc5c04a2, State: Initialized, Role: FOLLOWER
I20260807 19:47:55.856668 13043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef739fbc5384b2080f75908cc5c04a2" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41273 } }
I20260807 19:47:55.856969 13043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:47:55.857143 13043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:47:55.857350 13043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 0 FOLLOWER]: Advancing to term 1
Aug 07 19:47:55 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132075, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:47:55.860735 13043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef739fbc5384b2080f75908cc5c04a2" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41273 } }
I20260807 19:47:55.861658 13043 leader_election.cc:302] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 0ef739fbc5384b2080f75908cc5c04a2; no voters:
I20260807 19:47:55.862769 13043 leader_election.cc:288] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:47:55.862896 13054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:47:55.864737 13054 raft_consensus.cc:686] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [term 1 LEADER]: Becoming Leader. State: Replica: 0ef739fbc5384b2080f75908cc5c04a2, State: Running, Role: LEADER
I20260807 19:47:55.865571 13054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef739fbc5384b2080f75908cc5c04a2" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41273 } }
I20260807 19:47:55.866207 13043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:47:55.871760 13055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "0ef739fbc5384b2080f75908cc5c04a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef739fbc5384b2080f75908cc5c04a2" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41273 } } }
I20260807 19:47:55.872321 13055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [sys.catalog]: This master's current role is: LEADER
I20260807 19:47:55.872849 13057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 0ef739fbc5384b2080f75908cc5c04a2. Latest consensus state: current_term: 1 leader_uuid: "0ef739fbc5384b2080f75908cc5c04a2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "0ef739fbc5384b2080f75908cc5c04a2" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41273 } } }
I20260807 19:47:55.873458 13057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2 [sys.catalog]: This master's current role is: LEADER
I20260807 19:47:55.878664 13050 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:55.829619 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37384 (local address 127.12.155.190:41273)
0807 19:47:55.830858 (+ 1239us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:55.830880 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:55.832231 (+ 1351us) server_negotiation.cc:407] Connection header received
0807 19:47:55.844179 (+ 11948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:55.844208 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:55.844711 (+ 503us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:55.845183 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:55.849248 (+ 4065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:55.851026 (+ 1778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:55.853204 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:55.854163 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:55.854394 (+ 231us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:55.863327 (+ 8933us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:55.863352 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:55.863382 (+ 30us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:55.863460 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:55.869823 (+ 6363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:55.871650 (+ 1827us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:55.871667 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:55.871673 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:55.871897 (+ 224us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:55.872701 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:55.872708 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:55.872712 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:55.873729 (+ 1017us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:55.874183 (+ 454us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:55.875799 (+ 1616us) server_negotiation.cc:299] Negotiation successful
0807 19:47:55.876503 (+ 704us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":853,"thread_start_us":576,"threads_started":1}
I20260807 19:47:55.883797 13065 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:47:55.891461 13065 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:47:55.904703 13065 catalog_manager.cc:1347] Generated new cluster ID: 7944576cfd944f8cb8568b429f688e90
I20260807 19:47:55.904894 13065 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:47:55.920826 13065 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:47:55.922605 13065 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:47:55.932361 13065 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 0ef739fbc5384b2080f75908cc5c04a2: Generated new TSK 0
I20260807 19:47:55.933530 13065 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:47:55.996989 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41273
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:47:56.473821 13081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:47:56.474331 13081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:47:56.474552 13081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:47:56.483412 13081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:47:56.483626 13081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:47:56.483832 13081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:47:56.495977 13081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41273
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:47:56.498016 13081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:47:56.499984 13081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:47:56.517740 13089 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:56.517975 13094 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:56.517773 13092 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:47:56.519389 13081 server_base.cc:1034] running on GCE node
I20260807 19:47:56.520211 13081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:47:56.521577 13081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:47:56.522846 13081 hybrid_clock.cc:648] HybridClock initialized: now 1786132076522732 us; error 99 us; skew 500 ppm
I20260807 19:47:56.523290 13081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:47:56 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132076, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:47:56.527866 13081 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:47:56.530212 13081 webserver.cc:460] Webserver started at http://127.12.155.129:38801/ using document root <none> and password file <none>
I20260807 19:47:56.531216 13081 fs_manager.cc:359] Metadata directory not provided
I20260807 19:47:56.531386 13081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:47:56.531833 13081 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:47:56.535939 13081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "aa02b140679e4934adfd77887d32591a"
format_stamp: "Formatted at 2026-08-07 19:47:56 on dist-test-slave-2p8l"
server_key: "56ed75acd7f7092720e1f07aa87a7f78"
server_key_iv: "9d07011dee9cbe04f04afa53b0335d06"
server_key_version: "encryptionkey@0"
I20260807 19:47:56.536964 13081 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "aa02b140679e4934adfd77887d32591a"
format_stamp: "Formatted at 2026-08-07 19:47:56 on dist-test-slave-2p8l"
server_key: "56ed75acd7f7092720e1f07aa87a7f78"
server_key_iv: "9d07011dee9cbe04f04afa53b0335d06"
server_key_version: "encryptionkey@0"
I20260807 19:47:56.544503 13081 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 19:47:56.549420 13109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:56.551363 13081 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 19:47:56.551601 13081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "aa02b140679e4934adfd77887d32591a"
format_stamp: "Formatted at 2026-08-07 19:47:56 on dist-test-slave-2p8l"
server_key: "56ed75acd7f7092720e1f07aa87a7f78"
server_key_iv: "9d07011dee9cbe04f04afa53b0335d06"
server_key_version: "encryptionkey@0"
I20260807 19:47:56.551939 13081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:47:56.575670 13081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:47:56.582726 13081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:47:56.583202 13081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:47:56.584870 13081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:47:56.586963 13081 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:47:56.587062 13081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:56.587181 13081 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:47:56.587245 13081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:56.631943 13081 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:43559
I20260807 19:47:56.631981 13285 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:43559 every 8 connection(s)
I20260807 19:47:56.633693 13081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:47:56.640489 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13081
I20260807 19:47:56.640815 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:47:56.641897 12910 external_mini_cluster.cc:1428] Setting key 7cc75f86fddd230d0acbda5082505552
Aug 07 19:47:56 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132076, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:47:56.664352 13293 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:56.637268 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:39737 (local address 127.12.155.190:41273)
0807 19:47:56.637995 (+ 727us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:56.638005 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:56.639240 (+ 1235us) server_negotiation.cc:407] Connection header received
0807 19:47:56.642451 (+ 3211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:56.642457 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:56.642551 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:56.642670 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:56.645261 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:56.646603 (+ 1342us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:56.649594 (+ 2991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:56.650426 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:56.650595 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:56.655360 (+ 4765us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:56.655366 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:56.655369 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:56.655412 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:56.659064 (+ 3652us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:56.660532 (+ 1468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:56.660538 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:56.660541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:56.660732 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:56.661541 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:56.661546 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:56.661548 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:56.661996 (+ 448us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:56.662267 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:56.663546 (+ 1279us) server_negotiation.cc:299] Negotiation successful
0807 19:47:56.663984 (+ 438us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":517,"thread_start_us":329,"threads_started":1}
I20260807 19:47:56.666414 13295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:56.638043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:41273 (local address 127.12.155.129:39737)
0807 19:47:56.639015 (+ 972us) negotiation.cc:107] Waiting for socket to connect
0807 19:47:56.639070 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:47:56.641977 (+ 2907us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:47:56.643045 (+ 1068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:47:56.643082 (+ 37us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:47:56.643950 (+ 868us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:47:56.645013 (+ 1063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:47:56.645048 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:47:56.646858 (+ 1810us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:47:56.646867 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:47:56.649418 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:47:56.649434 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:47:56.650806 (+ 1372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:47:56.650814 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:47:56.651172 (+ 358us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:56.652179 (+ 1007us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:47:56.652214 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:47:56.654968 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:47:56.659291 (+ 4323us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:47:56.659307 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:47:56.659345 (+ 38us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:47:56.660325 (+ 980us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:47:56.660965 (+ 640us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:47:56.660974 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:47:56.660980 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:47:56.661373 (+ 393us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:47:56.662263 (+ 890us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:47:56.662276 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:47:56.662962 (+ 686us) client_negotiation.cc:769] Sending connection context
0807 19:47:56.663429 (+ 467us) client_negotiation.cc:240] Negotiation successful
0807 19:47:56.664238 (+ 809us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":632,"thread_start_us":373,"threads_started":1}
I20260807 19:47:56.668813 13290 heartbeater.cc:347] Connected to a master server at 127.12.155.190:41273
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
I20260807 19:47:56.669269 13290 heartbeater.cc:464] Registering TS with master...
I20260807 19:47:56.670713 13290 heartbeater.cc:511] Master 127.12.155.190:41273 requested a full tablet report, sending...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
I20260807 19:47:56.674327 12986 ts_manager.cc:194] Registered new tserver with Master: aa02b140679e4934adfd77887d32591a (127.12.155.129:43559)
I20260807 19:47:56.677012 12986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:39737
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:47:56.706085 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41273
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:47:57.160022 13299 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:47:57.160482 13299 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:47:57.160775 13299 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:47:57.169868 13299 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:47:57.170096 13299 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:47:57.170310 13299 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:47:57.182034 13299 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41273
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:47:57.184211 13299 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:47:57.186162 13299 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:47:57.204008 13308 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:57.203904 13309 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:57.203969 13313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:47:57.210490 13299 server_base.cc:1034] running on GCE node
I20260807 19:47:57.211418 13299 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:47:57.212937 13299 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:47:57.214349 13299 hybrid_clock.cc:648] HybridClock initialized: now 1786132077214273 us; error 60 us; skew 500 ppm
I20260807 19:47:57.214874 13299 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:47:57 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132077, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:47:57.219130 13299 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:47:57.221309 13299 webserver.cc:460] Webserver started at http://127.12.155.130:46599/ using document root <none> and password file <none>
I20260807 19:47:57.222417 13299 fs_manager.cc:359] Metadata directory not provided
I20260807 19:47:57.222599 13299 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:47:57.223034 13299 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:47:57.227113 13299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "7423f329909841f9ab42c6a96beaedb1"
format_stamp: "Formatted at 2026-08-07 19:47:57 on dist-test-slave-2p8l"
server_key: "5aeddc9c1e475ec9af7297a43776aaf0"
server_key_iv: "e4a5e1be3c911906c18a16229ef32bea"
server_key_version: "encryptionkey@0"
I20260807 19:47:57.228072 13299 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "7423f329909841f9ab42c6a96beaedb1"
format_stamp: "Formatted at 2026-08-07 19:47:57 on dist-test-slave-2p8l"
server_key: "5aeddc9c1e475ec9af7297a43776aaf0"
server_key_iv: "e4a5e1be3c911906c18a16229ef32bea"
server_key_version: "encryptionkey@0"
I20260807 19:47:57.234900 13299 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:47:57.239679 13325 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:57.241492 13299 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:47:57.241736 13299 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "7423f329909841f9ab42c6a96beaedb1"
format_stamp: "Formatted at 2026-08-07 19:47:57 on dist-test-slave-2p8l"
server_key: "5aeddc9c1e475ec9af7297a43776aaf0"
server_key_iv: "e4a5e1be3c911906c18a16229ef32bea"
server_key_version: "encryptionkey@0"
I20260807 19:47:57.242019 13299 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:47:57.262127 13299 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:47:57.268543 13299 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:47:57.269066 13299 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:47:57.270712 13299 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:47:57.272462 13299 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:47:57.272547 13299 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:57.272748 13299 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:47:57.272814 13299 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:57.317983 13299 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:43137
I20260807 19:47:57.317989 13506 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:43137 every 8 connection(s)
I20260807 19:47:57.319854 13299 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:47:57.327663 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13299
I20260807 19:47:57.327924 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:47:57.328689 12910 external_mini_cluster.cc:1428] Setting key 70c7f6b6346d74e38558bd8e1d5c80da
Aug 07 19:47:57 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132077, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:47:57.349797 13510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:57.323701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:50635 (local address 127.12.155.190:41273)
0807 19:47:57.324442 (+ 741us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:57.324451 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:57.325592 (+ 1141us) server_negotiation.cc:407] Connection header received
0807 19:47:57.328362 (+ 2770us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:57.328369 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:57.328483 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:57.328631 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:57.331216 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:57.332588 (+ 1372us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:57.334659 (+ 2071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:57.335552 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:57.335708 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:57.341142 (+ 5434us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:57.341148 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:57.341152 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:57.341191 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:57.344625 (+ 3434us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:57.345980 (+ 1355us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:57.345986 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:57.345988 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:57.346223 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:57.346957 (+ 734us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:57.346967 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:57.346973 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:57.347536 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:57.347785 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:57.348774 (+ 989us) server_negotiation.cc:299] Negotiation successful
0807 19:47:57.349142 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":539,"thread_start_us":354,"threads_started":1}
I20260807 19:47:57.350628 13511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:57.324358 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:41273 (local address 127.12.155.130:50635)
0807 19:47:57.325367 (+ 1009us) negotiation.cc:107] Waiting for socket to connect
0807 19:47:57.325422 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:47:57.327920 (+ 2498us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:47:57.329001 (+ 1081us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:47:57.329012 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:47:57.329886 (+ 874us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:47:57.330968 (+ 1082us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:47:57.331004 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:47:57.332817 (+ 1813us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:47:57.332822 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:47:57.334489 (+ 1667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:47:57.334504 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:47:57.335842 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:47:57.335849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:47:57.336117 (+ 268us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:57.337107 (+ 990us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:47:57.337141 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:47:57.340804 (+ 3663us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:47:57.344824 (+ 4020us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:47:57.344843 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:47:57.344883 (+ 40us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:47:57.345802 (+ 919us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:47:57.346354 (+ 552us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:47:57.346364 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:47:57.346371 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:47:57.346739 (+ 368us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:47:57.347730 (+ 991us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:47:57.347738 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:47:57.348266 (+ 528us) client_negotiation.cc:769] Sending connection context
0807 19:47:57.348554 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 19:47:57.349089 (+ 535us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":667,"thread_start_us":364,"threads_started":1}
I20260807 19:47:57.352947 13508 heartbeater.cc:347] Connected to a master server at 127.12.155.190:41273
I20260807 19:47:57.353489 13508 heartbeater.cc:464] Registering TS with master...
I20260807 19:47:57.354948 13508 heartbeater.cc:511] Master 127.12.155.190:41273 requested a full tablet report, sending...
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
I20260807 19:47:57.357404 12986 ts_manager.cc:194] Registered new tserver with Master: 7423f329909841f9ab42c6a96beaedb1 (127.12.155.130:43137)
I20260807 19:47:57.359112 12986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:50635
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:47:57.389883 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41273
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35485
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:47:57.681893 13290 heartbeater.cc:503] Master 127.12.155.190:41273 was elected leader, sending a full tablet report...
W20260807 19:47:57.847172 13515 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:47:57.847584 13515 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:47:57.847802 13515 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:47:57.857250 13515 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:47:57.857402 13515 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:47:57.857600 13515 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:47:57.869812 13515 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35485
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41273
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:47:57.871788 13515 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:47:57.873544 13515 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:47:57.890283 13523 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:57.890391 13528 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:47:57.890759 13525 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:47:57.891847 13515 server_base.cc:1034] running on GCE node
I20260807 19:47:57.892606 13515 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:47:57.893847 13515 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:47:57.895112 13515 hybrid_clock.cc:648] HybridClock initialized: now 1786132077895053 us; error 59 us; skew 500 ppm
I20260807 19:47:57.895524 13515 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:47:57 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132077, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:47:57.899926 13515 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:47:57.902036 13515 webserver.cc:460] Webserver started at http://127.12.155.131:34315/ using document root <none> and password file <none>
I20260807 19:47:57.902976 13515 fs_manager.cc:359] Metadata directory not provided
I20260807 19:47:57.903147 13515 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:47:57.903574 13515 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:47:57.907250 13515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "47d7b58357b64f10b7cc4bce4f05591d"
format_stamp: "Formatted at 2026-08-07 19:47:57 on dist-test-slave-2p8l"
server_key: "2ce2ddfee53ba6b7e60c2cb13876a0db"
server_key_iv: "177b58360cac61e529044e9cbd0b711a"
server_key_version: "encryptionkey@0"
I20260807 19:47:57.908219 13515 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "47d7b58357b64f10b7cc4bce4f05591d"
format_stamp: "Formatted at 2026-08-07 19:47:57 on dist-test-slave-2p8l"
server_key: "2ce2ddfee53ba6b7e60c2cb13876a0db"
server_key_iv: "177b58360cac61e529044e9cbd0b711a"
server_key_version: "encryptionkey@0"
I20260807 19:47:57.914872 13515 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:47:57.919358 13537 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:57.921329 13515 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:47:57.921569 13515 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "47d7b58357b64f10b7cc4bce4f05591d"
format_stamp: "Formatted at 2026-08-07 19:47:57 on dist-test-slave-2p8l"
server_key: "2ce2ddfee53ba6b7e60c2cb13876a0db"
server_key_iv: "177b58360cac61e529044e9cbd0b711a"
server_key_version: "encryptionkey@0"
I20260807 19:47:57.921886 13515 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:47:57.941473 13515 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:47:57.947183 13515 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:47:57.947535 13515 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:47:57.948887 13515 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:47:57.950795 13515 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:47:57.951049 13515 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:57.951318 13515 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:47:57.951445 13515 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:47:58.001410 13515 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:36389
I20260807 19:47:58.001433 13720 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:36389 every 8 connection(s)
I20260807 19:47:58.003379 13515 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:47:58.010852 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13515
I20260807 19:47:58.011112 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnListTablets.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:47:58.011650 12910 external_mini_cluster.cc:1428] Setting key 06c8f7d4cf118c9dcc26069b125c8af1
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132077, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:47:58.029240 13723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.007053 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:58363 (local address 127.12.155.190:41273)
0807 19:47:58.007725 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:58.007731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:58.009255 (+ 1524us) server_negotiation.cc:407] Connection header received
0807 19:47:58.011682 (+ 2427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:58.011690 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:58.011841 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:58.011997 (+ 156us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:58.014340 (+ 2343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.015195 (+ 855us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.017363 (+ 2168us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.017854 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.018014 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.022322 (+ 4308us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:58.022328 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:58.022332 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:58.022370 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:58.025201 (+ 2831us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.026106 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.026114 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.026118 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.026273 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.026771 (+ 498us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.026776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.026779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.027220 (+ 441us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:58.027416 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:58.028521 (+ 1105us) server_negotiation.cc:299] Negotiation successful
0807 19:47:58.028779 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":351,"threads_started":1}
I20260807 19:47:58.030680 13724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.007743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:41273 (local address 127.12.155.131:58363)
0807 19:47:58.009013 (+ 1270us) negotiation.cc:107] Waiting for socket to connect
0807 19:47:58.009076 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 19:47:58.011323 (+ 2247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:47:58.012307 (+ 984us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:47:58.012318 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:47:58.012967 (+ 649us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:47:58.014108 (+ 1141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:47:58.014143 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.015419 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.015425 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:47:58.017188 (+ 1763us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:47:58.017203 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.018165 (+ 962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.018173 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:47:58.018456 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.019320 (+ 864us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:47:58.019348 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:47:58.022017 (+ 2669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:47:58.025355 (+ 3338us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:47:58.025364 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:47:58.025381 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:47:58.025905 (+ 524us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:47:58.026400 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:47:58.026404 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:47:58.026407 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:47:58.026651 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:47:58.027443 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:47:58.027454 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:47:58.027996 (+ 542us) client_negotiation.cc:769] Sending connection context
0807 19:47:58.028384 (+ 388us) client_negotiation.cc:240] Negotiation successful
0807 19:47:58.028986 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"thread_start_us":444,"threads_started":1}
I20260807 19:47:58.032240 13721 heartbeater.cc:347] Connected to a master server at 127.12.155.190:41273
I20260807 19:47:58.032658 13721 heartbeater.cc:464] Registering TS with master...
I20260807 19:47:58.033632 13721 heartbeater.cc:511] Master 127.12.155.190:41273 requested a full tablet report, sending...
I20260807 19:47:58.035504 12986 ts_manager.cc:194] Registered new tserver with Master: 47d7b58357b64f10b7cc4bce4f05591d (127.12.155.131:36389)
I20260807 19:47:58.036489 12986 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:58363
I20260807 19:47:58.042665 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132078, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132078, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:47:58.108673 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.087670 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46346 (local address 127.12.155.129:43559)
0807 19:47:58.089002 (+ 1332us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:58.089014 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:58.089062 (+ 48us) server_negotiation.cc:407] Connection header received
0807 19:47:58.089261 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:58.089272 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:58.089588 (+ 316us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:58.089817 (+ 229us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:58.092230 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.093581 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.095270 (+ 1689us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.096205 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.096384 (+ 179us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.101484 (+ 5100us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:58.101499 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:58.101522 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:58.101579 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:58.105283 (+ 3704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.106188 (+ 905us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.106197 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.106199 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.106361 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.106771 (+ 410us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.106774 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.106776 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.107202 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:58.107477 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:58.107942 (+ 465us) server_negotiation.cc:299] Negotiation successful
0807 19:47:58.108290 (+ 348us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1076,"thread_start_us":685,"threads_started":1}
W20260807 19:47:58.110373 13149 server_base.cc:1116] Unauthorized access attempt to method kudu.tserver.TabletServerService.ListTablets from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:46346
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:47:58.173560 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.155909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46350 (local address 127.12.155.129:43559)
0807 19:47:58.156203 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:58.156214 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:58.156630 (+ 416us) server_negotiation.cc:407] Connection header received
0807 19:47:58.156907 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:58.156913 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:58.157022 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:58.157149 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:58.158825 (+ 1676us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.159629 (+ 804us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.160997 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.161490 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.161646 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.166708 (+ 5062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:58.166716 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:58.166720 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:58.166784 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:58.170630 (+ 3846us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.171438 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.171443 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.171445 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.171606 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.172040 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.172045 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.172047 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.172394 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:58.172632 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:58.172999 (+ 367us) server_negotiation.cc:299] Negotiation successful
0807 19:47:58.173216 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:47:58.176092 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13081
I20260807 19:47:58.192696 13734 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.177869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46366 (local address 127.12.155.129:43559)
0807 19:47:58.178167 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:58.178173 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:58.178195 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:47:58.178367 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:58.178372 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:58.178448 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:58.178553 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:58.179978 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.180764 (+ 786us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.182509 (+ 1745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.183064 (+ 555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.183185 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.186324 (+ 3139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:58.186330 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:58.186334 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:58.186378 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:58.189553 (+ 3175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.190474 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.190479 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.190481 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.190639 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.191175 (+ 536us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.191178 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.191180 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.191492 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:58.191684 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:58.192086 (+ 402us) server_negotiation.cc:299] Negotiation successful
0807 19:47:58.192297 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 19:47:58.193670 13280 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:47:58.287902 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13081
I20260807 19:47:58.318136 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13299
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:47:58.340274 13745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.319346 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53968 (local address 127.12.155.130:43137)
0807 19:47:58.320195 (+ 849us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:58.320207 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:58.320249 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:47:58.320356 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:58.320368 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:58.320742 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:58.320984 (+ 242us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:58.322587 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.324492 (+ 1905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.325938 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.326949 (+ 1011us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.327072 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.332500 (+ 5428us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:58.332520 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:58.332541 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:58.332590 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:58.336507 (+ 3917us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.337392 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.337417 (+ 25us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.337420 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.337608 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.338198 (+ 590us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.338204 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.338209 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.338785 (+ 576us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:58.339114 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:58.339458 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 19:47:58.339825 (+ 367us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":598,"thread_start_us":399,"threads_started":1}
I20260807 19:47:58.342270 13497 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:47:58.433595 13508 heartbeater.cc:503] Master 127.12.155.190:41273 was elected leader, sending a full tablet report...
I20260807 19:47:58.435446 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13299
W20260807 19:47:58.463964 12962 connection.cc:535] server connection from 127.12.155.130:50635 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 19:47:58.464442 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13515
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[12918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132078, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:47:58.485169 13747 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:47:58.465844 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58548 (local address 127.12.155.131:36389)
0807 19:47:58.466685 (+ 841us) server_negotiation.cc:206] Beginning negotiation
0807 19:47:58.466694 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:47:58.466735 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:47:58.466829 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:47:58.466837 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:47:58.467151 (+ 314us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:47:58.467385 (+ 234us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:47:58.468974 (+ 1589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.470305 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.471738 (+ 1433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:47:58.472429 (+ 691us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:47:58.472593 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:47:58.477801 (+ 5208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:47:58.477815 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:47:58.477838 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:47:58.477884 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:47:58.481505 (+ 3621us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.482402 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.482412 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.482414 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.482561 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:47:58.483004 (+ 443us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:47:58.483010 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:47:58.483013 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:47:58.483571 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:47:58.483933 (+ 362us) server_negotiation.cc:1035] Waiting for connection context
0807 19:47:58.484317 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 19:47:58.484675 (+ 358us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":639,"thread_start_us":403,"threads_started":1}
I20260807 19:47:58.487058 13715 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:47:58.580787 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13515
I20260807 19:47:58.613914 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 12934
I20260807 19:47:58.615738 13036 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:47:58.739923 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 12934
2026-08-07T19:47:58Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnListTablets (5304 ms)
[ RUN ] SecurityITest.TestAuthorizationOnChecksum
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[13759](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[13759](info): set up 2 sockets
Aug 07 19:47:58 dist-test-slave-2p8l krb5kdc[13759](info): commencing operation
krb5kdc: starting...
W20260807 19:48:00.143796 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.340s user 0.003s sys 0.023s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:00 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:00.395982 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40101
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40101
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:00.796729 13782 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:00.797158 13782 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:00.797266 13782 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:00.805363 13782 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:00.805516 13782 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:00.805568 13782 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:00.805636 13782 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:00.805685 13782 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:00.817011 13782 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40101
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40101
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:00.818883 13782 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:00.821026 13782 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:00.835850 13788 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:00.835937 13790 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:00.835881 13792 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:00.836961 13782 server_base.cc:1034] running on GCE node
I20260807 19:48:00.837957 13782 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:00.839876 13782 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:00.841102 13782 hybrid_clock.cc:648] HybridClock initialized: now 1786132080841039 us; error 48 us; skew 500 ppm
I20260807 19:48:00.841535 13782 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:00 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132080, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:00.845428 13782 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:00.847335 13782 webserver.cc:460] Webserver started at http://127.12.155.190:43135/ using document root <none> and password file <none>
I20260807 19:48:00.848192 13782 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:00.848331 13782 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:00.848680 13782 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:00.852762 13782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "eedbf08fb904423681d2314139891b30"
format_stamp: "Formatted at 2026-08-07 19:48:00 on dist-test-slave-2p8l"
server_key: "c55c82ad996337792dd9d2f64ace19bc"
server_key_iv: "b3eda35ce2d73ebbe9e9647c06a4b838"
server_key_version: "encryptionkey@0"
I20260807 19:48:00.853698 13782 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "eedbf08fb904423681d2314139891b30"
format_stamp: "Formatted at 2026-08-07 19:48:00 on dist-test-slave-2p8l"
server_key: "c55c82ad996337792dd9d2f64ace19bc"
server_key_iv: "b3eda35ce2d73ebbe9e9647c06a4b838"
server_key_version: "encryptionkey@0"
I20260807 19:48:00.860459 13782 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:00.865159 13803 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:00.867027 13782 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:48:00.867218 13782 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "eedbf08fb904423681d2314139891b30"
format_stamp: "Formatted at 2026-08-07 19:48:00 on dist-test-slave-2p8l"
server_key: "c55c82ad996337792dd9d2f64ace19bc"
server_key_iv: "b3eda35ce2d73ebbe9e9647c06a4b838"
server_key_version: "encryptionkey@0"
I20260807 19:48:00.867439 13782 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:00.880858 13782 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:00.886416 13782 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:00.886734 13782 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:00.908999 13782 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:40101
I20260807 19:48:00.909027 13888 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:40101 every 8 connection(s)
I20260807 19:48:00.910877 13782 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:00.913419 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13782
I20260807 19:48:00.913702 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:00.914547 12910 external_mini_cluster.cc:1428] Setting key ef76a887b3491d5307f3f8dc60e43396
I20260807 19:48:00.916887 13889 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:48:00 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:00.934423 13889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30: Bootstrap starting.
I20260807 19:48:00.940358 13889 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:00.942219 13889 log.cc:824] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:00.946852 13893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:00.917088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59616 (local address 127.12.155.190:40101)
0807 19:48:00.918121 (+ 1033us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:00.918141 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:00.918209 (+ 68us) server_negotiation.cc:407] Connection header received
0807 19:48:00.921023 (+ 2814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:00.921061 (+ 38us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:00.921906 (+ 845us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:00.922551 (+ 645us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:00.924281 (+ 1730us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:00.926880 (+ 2599us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:00.928532 (+ 1652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:00.929771 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:00.930012 (+ 241us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:00.935022 (+ 5010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:00.935038 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:00.935067 (+ 29us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:00.935128 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:00.940218 (+ 5090us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:00.941313 (+ 1095us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:00.941325 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:00.941336 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:00.941601 (+ 265us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:00.942215 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:00.942221 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:00.942224 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:00.943211 (+ 987us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:00.943507 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:00.944444 (+ 937us) server_negotiation.cc:299] Negotiation successful
0807 19:48:00.945038 (+ 594us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":723,"thread_start_us":438,"threads_started":1}
I20260807 19:48:00.947170 13889 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30: No bootstrap required, opened a new log
I20260807 19:48:00.957880 13889 raft_consensus.cc:348] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedbf08fb904423681d2314139891b30" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40101 } }
I20260807 19:48:00.958490 13889 raft_consensus.cc:374] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:00.958592 13889 raft_consensus.cc:729] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eedbf08fb904423681d2314139891b30, State: Initialized, Role: FOLLOWER
I20260807 19:48:00.959343 13889 consensus_queue.cc:260] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedbf08fb904423681d2314139891b30" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40101 } }
I20260807 19:48:00.959585 13889 raft_consensus.cc:388] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:00.959700 13889 raft_consensus.cc:482] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:00.959869 13889 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:00.962522 13889 raft_consensus.cc:504] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedbf08fb904423681d2314139891b30" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40101 } }
I20260807 19:48:00.963292 13889 leader_election.cc:302] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eedbf08fb904423681d2314139891b30; no voters:
I20260807 19:48:00.964121 13889 leader_election.cc:288] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:00.964262 13897 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:00.965171 13897 raft_consensus.cc:686] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [term 1 LEADER]: Becoming Leader. State: Replica: eedbf08fb904423681d2314139891b30, State: Running, Role: LEADER
I20260807 19:48:00.965921 13897 consensus_queue.cc:237] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedbf08fb904423681d2314139891b30" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40101 } }
I20260807 19:48:00.966835 13889 sys_catalog.cc:564] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:00.969203 13898 sys_catalog.cc:455] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eedbf08fb904423681d2314139891b30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedbf08fb904423681d2314139891b30" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40101 } } }
I20260807 19:48:00.969633 13898 sys_catalog.cc:458] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:00.970369 13900 sys_catalog.cc:455] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eedbf08fb904423681d2314139891b30. Latest consensus state: current_term: 1 leader_uuid: "eedbf08fb904423681d2314139891b30" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eedbf08fb904423681d2314139891b30" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40101 } } }
I20260807 19:48:00.970748 13900 sys_catalog.cc:458] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:00.971104 13905 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:00.979068 13905 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:00.990260 13905 catalog_manager.cc:1347] Generated new cluster ID: 6f3efd41cd174a32ba5b331f983d0733
I20260807 19:48:00.990407 13905 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:01.023518 13905 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:01.025879 13905 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:01.049998 13905 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eedbf08fb904423681d2314139891b30: Generated new TSK 0
I20260807 19:48:01.051692 13905 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:01.122826 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40101
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:01.535583 13926 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:01.536031 13926 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:01.536232 13926 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:01.544237 13926 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:01.544440 13926 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:01.544672 13926 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:01.556185 13926 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40101
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:01.558043 13926 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:01.559837 13926 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:01.576474 13938 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:01.576498 13936 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:01.576558 13935 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:01.577394 13926 server_base.cc:1034] running on GCE node
I20260807 19:48:01.578281 13926 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:01.579536 13926 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:01.580830 13926 hybrid_clock.cc:648] HybridClock initialized: now 1786132081580783 us; error 49 us; skew 500 ppm
I20260807 19:48:01.581250 13926 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:01 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132081, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:01.585222 13926 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:01.587132 13926 webserver.cc:460] Webserver started at http://127.12.155.129:43713/ using document root <none> and password file <none>
I20260807 19:48:01.587977 13926 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:01.588092 13926 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:01.588429 13926 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:01.592127 13926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "fc29ba49be614a75b1a18b6edf15fa02"
format_stamp: "Formatted at 2026-08-07 19:48:01 on dist-test-slave-2p8l"
server_key: "a364d245ae90d7802e1c5919bd1e7ab9"
server_key_iv: "fc92bcea09c2531145b82e01cf3bb0ae"
server_key_version: "encryptionkey@0"
I20260807 19:48:01.593063 13926 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "fc29ba49be614a75b1a18b6edf15fa02"
format_stamp: "Formatted at 2026-08-07 19:48:01 on dist-test-slave-2p8l"
server_key: "a364d245ae90d7802e1c5919bd1e7ab9"
server_key_iv: "fc92bcea09c2531145b82e01cf3bb0ae"
server_key_version: "encryptionkey@0"
I20260807 19:48:01.599736 13926 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 19:48:01.604324 13949 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:01.606192 13926 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:48:01.606427 13926 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "fc29ba49be614a75b1a18b6edf15fa02"
format_stamp: "Formatted at 2026-08-07 19:48:01 on dist-test-slave-2p8l"
server_key: "a364d245ae90d7802e1c5919bd1e7ab9"
server_key_iv: "fc92bcea09c2531145b82e01cf3bb0ae"
server_key_version: "encryptionkey@0"
I20260807 19:48:01.606684 13926 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:01.629117 13926 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:01.634949 13926 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:01.635339 13926 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:01.636667 13926 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:01.638520 13926 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:01.638607 13926 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:01.638789 13926 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:01.638862 13926 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:01.682278 13926 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:33701
I20260807 19:48:01.682301 14113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:33701 every 8 connection(s)
I20260807 19:48:01.684494 13926 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:01.694118 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13926
I20260807 19:48:01.694428 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:01.695209 12910 external_mini_cluster.cc:1428] Setting key 894ef86f84bafdaa0436733397345093
Aug 07 19:48:01 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132081, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:01.710644 14116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:01.688071 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:47713 (local address 127.12.155.190:40101)
0807 19:48:01.688716 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:01.688721 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:01.689709 (+ 988us) server_negotiation.cc:407] Connection header received
0807 19:48:01.692056 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:01.692063 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:01.692184 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:01.692326 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:01.694943 (+ 2617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:01.695876 (+ 933us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:01.697691 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:01.698206 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:01.698367 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:01.703019 (+ 4652us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:01.703025 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:01.703029 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:01.703070 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:01.706548 (+ 3478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:01.707468 (+ 920us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:01.707477 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:01.707482 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:01.707675 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:01.708160 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:01.708167 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:01.708173 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:01.708638 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:01.708827 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:01.709731 (+ 904us) server_negotiation.cc:299] Negotiation successful
0807 19:48:01.710107 (+ 376us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":510,"thread_start_us":354,"threads_started":1}
I20260807 19:48:01.712034 14118 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:01.688625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40101 (local address 127.12.155.129:47713)
0807 19:48:01.689494 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:01.689544 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:01.691690 (+ 2146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:01.692649 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:01.692660 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:01.693590 (+ 930us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:01.694608 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:01.694636 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:01.696057 (+ 1421us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:01.696062 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:01.697497 (+ 1435us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:01.697513 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:01.698514 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:01.698522 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:01.698841 (+ 319us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:01.699864 (+ 1023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:01.699905 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:01.702716 (+ 2811us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:01.706723 (+ 4007us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:01.706733 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:01.706753 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:01.707300 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:01.707798 (+ 498us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:01.707802 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:01.707804 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:01.708028 (+ 224us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:01.708772 (+ 744us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:01.708780 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:01.709226 (+ 446us) client_negotiation.cc:769] Sending connection context
0807 19:48:01.709553 (+ 327us) client_negotiation.cc:240] Negotiation successful
0807 19:48:01.710249 (+ 696us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":569,"thread_start_us":324,"threads_started":1}
I20260807 19:48:01.714370 14114 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40101
I20260807 19:48:01.714895 14114 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:01.715963 14114 heartbeater.cc:511] Master 127.12.155.190:40101 requested a full tablet report, sending...
I20260807 19:48:01.719522 13832 ts_manager.cc:194] Registered new tserver with Master: fc29ba49be614a75b1a18b6edf15fa02 (127.12.155.129:33701)
I20260807 19:48:01.722393 13832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:47713
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:01.758719 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40101
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:02.174672 14122 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:02.175103 14122 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:02.175293 14122 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:02.183744 14122 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:02.183979 14122 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:02.184187 14122 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:02.195916 14122 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40101
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:02.197937 14122 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:02.199712 14122 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:02.216164 14134 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:02.216255 14131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:02.216500 14130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:02.217594 14122 server_base.cc:1034] running on GCE node
I20260807 19:48:02.218454 14122 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:02.219645 14122 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:02.220906 14122 hybrid_clock.cc:648] HybridClock initialized: now 1786132082220846 us; error 49 us; skew 500 ppm
I20260807 19:48:02.221297 14122 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:02 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132082, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:02.225431 14122 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:02.227496 14122 webserver.cc:460] Webserver started at http://127.12.155.130:37317/ using document root <none> and password file <none>
I20260807 19:48:02.228438 14122 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:02.228606 14122 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:02.229015 14122 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:02.232764 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a"
format_stamp: "Formatted at 2026-08-07 19:48:02 on dist-test-slave-2p8l"
server_key: "6539ae96be9b26d6e03789449672fe69"
server_key_iv: "89d500fec378dca4bcd7f1cdf0f38e4f"
server_key_version: "encryptionkey@0"
I20260807 19:48:02.233743 14122 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a"
format_stamp: "Formatted at 2026-08-07 19:48:02 on dist-test-slave-2p8l"
server_key: "6539ae96be9b26d6e03789449672fe69"
server_key_iv: "89d500fec378dca4bcd7f1cdf0f38e4f"
server_key_version: "encryptionkey@0"
I20260807 19:48:02.240582 14122 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:02.245697 14146 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:02.247867 14122 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:48:02.248137 14122 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a"
format_stamp: "Formatted at 2026-08-07 19:48:02 on dist-test-slave-2p8l"
server_key: "6539ae96be9b26d6e03789449672fe69"
server_key_iv: "89d500fec378dca4bcd7f1cdf0f38e4f"
server_key_version: "encryptionkey@0"
I20260807 19:48:02.248430 14122 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:02.273758 14122 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:02.279670 14122 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:02.280038 14122 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:02.281330 14122 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:02.283025 14122 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:02.283109 14122 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:02.283324 14122 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:02.283381 14122 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:02.324524 14122 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:40103
I20260807 19:48:02.324568 14326 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:40103 every 8 connection(s)
I20260807 19:48:02.326345 14122 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:02.330703 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14122
I20260807 19:48:02.330999 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:02.331696 12910 external_mini_cluster.cc:1428] Setting key 4f1384bc94b10cfcca1da36ebc58d443
Aug 07 19:48:02 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132082, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:02.354822 14330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:02.329737 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:54343 (local address 127.12.155.190:40101)
0807 19:48:02.330449 (+ 712us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:02.330454 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:02.331670 (+ 1216us) server_negotiation.cc:407] Connection header received
0807 19:48:02.334262 (+ 2592us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:02.334267 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:02.334356 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:02.334506 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:02.336508 (+ 2002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.337808 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.339848 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.340666 (+ 818us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.340834 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:02.346112 (+ 5278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:02.346124 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:02.346134 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:02.346201 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:02.350785 (+ 4584us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:02.351751 (+ 966us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:02.351757 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:02.351761 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:02.351923 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:02.352465 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:02.352477 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:02.352481 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:02.352864 (+ 383us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:02.353039 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:02.354085 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0807 19:48:02.354375 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":572,"thread_start_us":385,"threads_started":1}
I20260807 19:48:02.356182 14331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:02.330421 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40101 (local address 127.12.155.130:54343)
0807 19:48:02.331462 (+ 1041us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:02.331510 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:02.333858 (+ 2348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:02.334817 (+ 959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:02.334828 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:02.335484 (+ 656us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:02.336271 (+ 787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:02.336303 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.338013 (+ 1710us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.338018 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:02.339660 (+ 1642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:02.339675 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.341006 (+ 1331us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.341012 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:02.341288 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:02.342385 (+ 1097us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:02.342417 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:02.345749 (+ 3332us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:02.350978 (+ 5229us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:02.350989 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:02.351009 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:02.351594 (+ 585us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:02.352050 (+ 456us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:02.352058 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:02.352063 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:02.352321 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:02.353002 (+ 681us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:02.353011 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:02.353570 (+ 559us) client_negotiation.cc:769] Sending connection context
0807 19:48:02.353954 (+ 384us) client_negotiation.cc:240] Negotiation successful
0807 19:48:02.354702 (+ 748us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":732,"thread_start_us":431,"threads_started":1}
I20260807 19:48:02.358228 14328 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40101
I20260807 19:48:02.358752 14328 heartbeater.cc:464] Registering TS with master...
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
I20260807 19:48:02.360040 14328 heartbeater.cc:511] Master 127.12.155.190:40101 requested a full tablet report, sending...
I20260807 19:48:02.362367 13832 ts_manager.cc:194] Registered new tserver with Master: 1a2f04cc66ec49b5bcf7ea1771907c8a (127.12.155.130:40103)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
I20260807 19:48:02.363646 13832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:54343
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:02.394266 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40101
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40047
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_enforce_access_control with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:02.727761 14114 heartbeater.cc:503] Master 127.12.155.190:40101 was elected leader, sending a full tablet report...
W20260807 19:48:02.801774 14335 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:02.802177 14335 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:02.802290 14335 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:02.810200 14335 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:02.810426 14335 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:02.810679 14335 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:02.822434 14335 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40047
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40101
--tserver_enforce_access_control=true
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:02.824381 14335 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:02.826243 14335 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:02.842407 14341 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:02.842357 14344 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:02.842363 14348 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:02.843688 14335 server_base.cc:1034] running on GCE node
I20260807 19:48:02.844506 14335 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:02.845736 14335 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:02.846992 14335 hybrid_clock.cc:648] HybridClock initialized: now 1786132082846932 us; error 46 us; skew 500 ppm
I20260807 19:48:02.847369 14335 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:02 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132082, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:02.851423 14335 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:02.853497 14335 webserver.cc:460] Webserver started at http://127.12.155.131:42077/ using document root <none> and password file <none>
I20260807 19:48:02.854573 14335 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:02.854727 14335 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:02.855166 14335 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:02.859050 14335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "f9f32b66414a45298922e22099f0c4e8"
format_stamp: "Formatted at 2026-08-07 19:48:02 on dist-test-slave-2p8l"
server_key: "51113a725ac003c830cd364d047e2ff2"
server_key_iv: "bd0f4079c9a93777a1c13b99d4e8685b"
server_key_version: "encryptionkey@0"
I20260807 19:48:02.860042 14335 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "f9f32b66414a45298922e22099f0c4e8"
format_stamp: "Formatted at 2026-08-07 19:48:02 on dist-test-slave-2p8l"
server_key: "51113a725ac003c830cd364d047e2ff2"
server_key_iv: "bd0f4079c9a93777a1c13b99d4e8685b"
server_key_version: "encryptionkey@0"
I20260807 19:48:02.866928 14335 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 19:48:02.871627 14357 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:02.873952 14335 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:48:02.874291 14335 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "f9f32b66414a45298922e22099f0c4e8"
format_stamp: "Formatted at 2026-08-07 19:48:02 on dist-test-slave-2p8l"
server_key: "51113a725ac003c830cd364d047e2ff2"
server_key_iv: "bd0f4079c9a93777a1c13b99d4e8685b"
server_key_version: "encryptionkey@0"
I20260807 19:48:02.874565 14335 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:02.902042 14335 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:02.907531 14335 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:02.907869 14335 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:02.909353 14335 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:02.911577 14335 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:02.911706 14335 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:02.911893 14335 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:02.911979 14335 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:02.955338 14335 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:39837
I20260807 19:48:02.955500 14539 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:39837 every 8 connection(s)
I20260807 19:48:02.957345 14335 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:02.964551 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14335
I20260807 19:48:02.964869 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizationOnChecksum.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:02.965595 12910 external_mini_cluster.cc:1428] Setting key 7b3b105870ea29e21ae71c672e5405d8
Aug 07 19:48:02 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132082, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:02.985600 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:02.960875 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:43649 (local address 127.12.155.190:40101)
0807 19:48:02.961615 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:02.961620 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:02.962612 (+ 992us) server_negotiation.cc:407] Connection header received
0807 19:48:02.964790 (+ 2178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:02.964796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:02.964919 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:02.965065 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:02.967696 (+ 2631us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.968869 (+ 1173us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.971182 (+ 2313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.971828 (+ 646us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.971955 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:02.976928 (+ 4973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:02.976935 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:02.976939 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:02.976984 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:02.981062 (+ 4078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:02.982285 (+ 1223us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:02.982289 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:02.982292 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:02.982444 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:02.983237 (+ 793us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:02.983242 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:02.983245 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:02.983709 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:02.983966 (+ 257us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:02.985012 (+ 1046us) server_negotiation.cc:299] Negotiation successful
0807 19:48:02.985235 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":611,"thread_start_us":429,"threads_started":1}
I20260807 19:48:02.986945 14544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:02.961442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40101 (local address 127.12.155.131:43649)
0807 19:48:02.962418 (+ 976us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:02.962465 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:02.964470 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:02.965407 (+ 937us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:02.965422 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:02.966497 (+ 1075us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:02.967446 (+ 949us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:02.967477 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.969071 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.969077 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:02.970994 (+ 1917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:02.971009 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:02.972213 (+ 1204us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:02.972221 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:02.972562 (+ 341us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:02.973591 (+ 1029us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:02.973621 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:02.976607 (+ 2986us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:02.981251 (+ 4644us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:02.981260 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:02.981277 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:02.982112 (+ 835us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:02.982598 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:02.982604 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:02.982608 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:02.982991 (+ 383us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:02.984008 (+ 1017us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:02.984019 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:02.984499 (+ 480us) client_negotiation.cc:769] Sending connection context
0807 19:48:02.984835 (+ 336us) client_negotiation.cc:240] Negotiation successful
0807 19:48:02.985372 (+ 537us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":375,"threads_started":1}
I20260807 19:48:02.988660 14541 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40101
I20260807 19:48:02.989055 14541 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:02.989955 14541 heartbeater.cc:511] Master 127.12.155.190:40101 requested a full tablet report, sending...
I20260807 19:48:02.991724 13832 ts_manager.cc:194] Registered new tserver with Master: f9f32b66414a45298922e22099f0c4e8 (127.12.155.131:39837)
I20260807 19:48:02.992865 13832 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:43649
I20260807 19:48:02.996766 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:48:03.019908 14543 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.004729 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59630 (local address 127.12.155.190:40101)
0807 19:48:03.004986 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.004997 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.005499 (+ 502us) server_negotiation.cc:407] Connection header received
0807 19:48:03.005674 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.005679 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.005829 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.005926 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.007782 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.008626 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.010011 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.010515 (+ 504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.010625 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.013599 (+ 2974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.013604 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.013608 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.013648 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.016994 (+ 3346us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.017667 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.017671 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.017674 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.017867 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.018275 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.018280 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.018283 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.018667 (+ 384us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.018930 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.019204 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.019434 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:48:03.028716 13832 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59630:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:03.037007 13832 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:03.075373 14567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.060168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36886 (local address 127.12.155.131:39837)
0807 19:48:03.061038 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.061045 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.061072 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:48:03.061215 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.061224 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.061471 (+ 247us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.061700 (+ 229us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:03.062911 (+ 1211us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.065150 (+ 2239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.069259 (+ 4109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.071742 (+ 2483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.074220 (+ 2478us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.074522 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.074643 (+ 121us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.074888 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":703,"thread_start_us":763,"threads_started":1}
I20260807 19:48:03.075430 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.059426 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42222 (local address 127.12.155.129:33701)
0807 19:48:03.060268 (+ 842us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.060282 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.060326 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:48:03.060465 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.060477 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.060854 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.061178 (+ 324us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:03.062044 (+ 866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.064632 (+ 2588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.069438 (+ 4806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.072146 (+ 2708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.072475 (+ 329us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.074440 (+ 1965us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.074566 (+ 126us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.074839 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":623,"thread_start_us":1108,"threads_started":1}
I20260807 19:48:03.076010 14562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.058410 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:39837 (local address 127.0.0.1:36886)
0807 19:48:03.059204 (+ 794us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:03.059227 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:03.059355 (+ 128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:03.062044 (+ 2689us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:03.062048 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:03.062108 (+ 60us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:03.062646 (+ 538us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.062661 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.065395 (+ 2734us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.065403 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.068933 (+ 3530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.068962 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.072173 (+ 3211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.072184 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.072595 (+ 411us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.072690 (+ 95us) client_negotiation.cc:769] Sending connection context
0807 19:48:03.072929 (+ 239us) client_negotiation.cc:240] Negotiation successful
0807 19:48:03.073353 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":661,"mutex_wait_us":5,"thread_start_us":2369,"threads_started":1}
I20260807 19:48:03.076072 14561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.057829 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:33701 (local address 127.0.0.1:42222)
0807 19:48:03.058902 (+ 1073us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:03.058969 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:03.059271 (+ 302us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:03.061216 (+ 1945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:03.061225 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:03.061262 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:03.061841 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.061860 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.064879 (+ 3019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.064889 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.069120 (+ 4231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.069147 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.072842 (+ 3695us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.072853 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.073278 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.073342 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 19:48:03.073461 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 19:48:03.073702 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":5,"thread_start_us":498,"threads_started":1}
I20260807 19:48:03.082204 14023 tablet_service.cc:1467] Processing CreateTablet for tablet 461d0d211c0141eaab36ac0542d98ab8 (DEFAULT_TABLE table=test-table [id=73434ac537ba45299648e0a2f30ac137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:03.082203 14437 tablet_service.cc:1467] Processing CreateTablet for tablet 461d0d211c0141eaab36ac0542d98ab8 (DEFAULT_TABLE table=test-table [id=73434ac537ba45299648e0a2f30ac137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:03.084789 14437 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461d0d211c0141eaab36ac0542d98ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:03.084789 14023 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461d0d211c0141eaab36ac0542d98ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:03.086561 14569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.062374 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:40103 (local address 127.0.0.1:43544)
0807 19:48:03.076274 (+ 13900us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:03.076304 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:03.076502 (+ 198us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:03.078559 (+ 2057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:03.078563 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:03.078592 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:03.078978 (+ 386us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.078990 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.080965 (+ 1975us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.080971 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.083239 (+ 2268us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.083260 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.085475 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.085481 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.085651 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.085684 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:48:03.085826 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 19:48:03.086010 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13682,"thread_start_us":14232,"threads_started":1}
I20260807 19:48:03.086576 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.062448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43544 (local address 127.12.155.130:40103)
0807 19:48:03.075304 (+ 12856us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.075315 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.077335 (+ 2020us) server_negotiation.cc:407] Connection header received
0807 19:48:03.077502 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.077513 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.077914 (+ 401us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.078271 (+ 357us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:03.079217 (+ 946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.080789 (+ 1572us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.083612 (+ 2823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.084849 (+ 1237us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.085118 (+ 269us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.085312 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.085889 (+ 577us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.086152 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12576,"thread_start_us":12844,"threads_started":1}
I20260807 19:48:03.095499 14223 tablet_service.cc:1467] Processing CreateTablet for tablet 461d0d211c0141eaab36ac0542d98ab8 (DEFAULT_TABLE table=test-table [id=73434ac537ba45299648e0a2f30ac137]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:03.097829 14223 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 461d0d211c0141eaab36ac0542d98ab8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:03.105079 14573 tablet_bootstrap.cc:492] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: Bootstrap starting.
I20260807 19:48:03.112982 14575 tablet_bootstrap.cc:492] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: Bootstrap starting.
I20260807 19:48:03.113234 14573 tablet_bootstrap.cc:654] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:03.114904 14573 log.cc:824] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:03.117980 14579 tablet_bootstrap.cc:492] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: Bootstrap starting.
I20260807 19:48:03.118113 14575 tablet_bootstrap.cc:654] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:03.119306 14573 tablet_bootstrap.cc:492] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: No bootstrap required, opened a new log
I20260807 19:48:03.119683 14573 ts_tablet_manager.cc:1397] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20260807 19:48:03.120376 14575 log.cc:824] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:03.122987 14579 tablet_bootstrap.cc:654] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:03.124375 14579 log.cc:824] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:03.125093 14575 tablet_bootstrap.cc:492] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: No bootstrap required, opened a new log
I20260807 19:48:03.125560 14575 ts_tablet_manager.cc:1397] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.006s
I20260807 19:48:03.128206 14579 tablet_bootstrap.cc:492] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: No bootstrap required, opened a new log
I20260807 19:48:03.128558 14579 ts_tablet_manager.cc:1397] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.005s
I20260807 19:48:03.134703 14573 raft_consensus.cc:348] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.135396 14573 raft_consensus.cc:374] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:03.135555 14573 raft_consensus.cc:729] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc29ba49be614a75b1a18b6edf15fa02, State: Initialized, Role: FOLLOWER
I20260807 19:48:03.136478 14573 consensus_queue.cc:260] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.139357 14573 ts_tablet_manager.cc:1428] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: Time spent starting tablet: real 0.019s user 0.015s sys 0.004s
I20260807 19:48:03.139365 14575 raft_consensus.cc:348] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.139430 14579 raft_consensus.cc:348] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.139955 14575 raft_consensus.cc:374] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:03.139986 14579 raft_consensus.cc:374] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:03.140108 14579 raft_consensus.cc:729] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1a2f04cc66ec49b5bcf7ea1771907c8a, State: Initialized, Role: FOLLOWER
I20260807 19:48:03.140110 14575 raft_consensus.cc:729] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f9f32b66414a45298922e22099f0c4e8, State: Initialized, Role: FOLLOWER
I20260807 19:48:03.140924 14575 consensus_queue.cc:260] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.141090 14579 consensus_queue.cc:260] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.143442 14575 ts_tablet_manager.cc:1428] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: Time spent starting tablet: real 0.018s user 0.016s sys 0.000s
I20260807 19:48:03.143419 14328 heartbeater.cc:503] Master 127.12.155.190:40101 was elected leader, sending a full tablet report...
I20260807 19:48:03.144485 14541 heartbeater.cc:503] Master 127.12.155.190:40101 was elected leader, sending a full tablet report...
I20260807 19:48:03.144659 14579 ts_tablet_manager.cc:1428] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: Time spent starting tablet: real 0.016s user 0.014s sys 0.002s
I20260807 19:48:03.149703 14593 raft_consensus.cc:482] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:03.150144 14593 raft_consensus.cc:504] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.152279 14593 leader_election.cc:288] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f9f32b66414a45298922e22099f0c4e8 (127.12.155.131:39837), 1a2f04cc66ec49b5bcf7ea1771907c8a (127.12.155.130:40103)
I20260807 19:48:03.161751 14567 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.152691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:39449 (local address 127.12.155.131:39837)
0807 19:48:03.153065 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.153075 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.154833 (+ 1758us) server_negotiation.cc:407] Connection header received
0807 19:48:03.155170 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.155179 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.155281 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.155366 (+ 85us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:03.156189 (+ 823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.157074 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.159438 (+ 2364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.160676 (+ 1238us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.160881 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.160977 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.161282 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.161428 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":157}
I20260807 19:48:03.161808 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.153289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:48915 (local address 127.12.155.130:40103)
0807 19:48:03.153604 (+ 315us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.153614 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.155027 (+ 1413us) server_negotiation.cc:407] Connection header received
0807 19:48:03.155237 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.155241 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.155315 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.155439 (+ 124us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:03.156294 (+ 855us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.157097 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.159578 (+ 2481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.160513 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.160665 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.160737 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.161222 (+ 485us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.161396 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 19:48:03.161976 14597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.152897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:40103 (local address 127.12.155.129:48915)
0807 19:48:03.154905 (+ 2008us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:03.154922 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:03.155090 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:03.155482 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:03.155487 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:03.155515 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:03.156085 (+ 570us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.156121 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.157299 (+ 1178us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.157303 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.159396 (+ 2093us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.159414 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.160787 (+ 1373us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.160796 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.161012 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.161056 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 19:48:03.161156 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 19:48:03.161343 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1890,"mutex_wait_us":88,"thread_start_us":1371,"threads_started":1}
I20260807 19:48:03.162184 14596 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.152674 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:39837 (local address 127.12.155.129:39449)
0807 19:48:03.154705 (+ 2031us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:03.154725 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:03.154935 (+ 210us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:03.155418 (+ 483us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:03.155425 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:03.155454 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:03.156018 (+ 564us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.156030 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.157233 (+ 1203us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.157240 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.159264 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:03.159279 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.160941 (+ 1662us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.160946 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:03.161081 (+ 135us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.161106 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:48:03.161234 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 19:48:03.161388 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1875,"mutex_wait_us":6,"thread_start_us":963,"threads_started":1}
I20260807 19:48:03.163578 14255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461d0d211c0141eaab36ac0542d98ab8" candidate_uuid: "fc29ba49be614a75b1a18b6edf15fa02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" is_pre_election: true
I20260807 19:48:03.163620 14464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461d0d211c0141eaab36ac0542d98ab8" candidate_uuid: "fc29ba49be614a75b1a18b6edf15fa02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f32b66414a45298922e22099f0c4e8" is_pre_election: true
I20260807 19:48:03.164393 14464 raft_consensus.cc:2454] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc29ba49be614a75b1a18b6edf15fa02 in term 0.
I20260807 19:48:03.164398 14255 raft_consensus.cc:2454] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc29ba49be614a75b1a18b6edf15fa02 in term 0.
I20260807 19:48:03.165416 13951 leader_election.cc:302] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: f9f32b66414a45298922e22099f0c4e8, fc29ba49be614a75b1a18b6edf15fa02; no voters:
I20260807 19:48:03.166190 14593 raft_consensus.cc:2781] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:03.166533 14593 raft_consensus.cc:482] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:03.166811 14593 raft_consensus.cc:3037] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:03.170198 14593 raft_consensus.cc:504] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.171042 14593 leader_election.cc:288] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [CANDIDATE]: Term 1 election: Requested vote from peers f9f32b66414a45298922e22099f0c4e8 (127.12.155.131:39837), 1a2f04cc66ec49b5bcf7ea1771907c8a (127.12.155.130:40103)
I20260807 19:48:03.171826 14464 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461d0d211c0141eaab36ac0542d98ab8" candidate_uuid: "fc29ba49be614a75b1a18b6edf15fa02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f9f32b66414a45298922e22099f0c4e8"
I20260807 19:48:03.171898 14255 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "461d0d211c0141eaab36ac0542d98ab8" candidate_uuid: "fc29ba49be614a75b1a18b6edf15fa02" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a"
I20260807 19:48:03.172145 14464 raft_consensus.cc:3037] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:03.172207 14255 raft_consensus.cc:3037] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:03.176553 14255 raft_consensus.cc:2454] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc29ba49be614a75b1a18b6edf15fa02 in term 1.
I20260807 19:48:03.176553 14464 raft_consensus.cc:2454] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc29ba49be614a75b1a18b6edf15fa02 in term 1.
I20260807 19:48:03.177335 13952 leader_election.cc:302] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1a2f04cc66ec49b5bcf7ea1771907c8a, fc29ba49be614a75b1a18b6edf15fa02; no voters:
I20260807 19:48:03.177872 14593 raft_consensus.cc:2781] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:03.178525 14593 raft_consensus.cc:686] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [term 1 LEADER]: Becoming Leader. State: Replica: fc29ba49be614a75b1a18b6edf15fa02, State: Running, Role: LEADER
I20260807 19:48:03.179273 14593 consensus_queue.cc:237] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } }
I20260807 19:48:03.186244 13830 catalog_manager.cc:5495] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc29ba49be614a75b1a18b6edf15fa02 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "fc29ba49be614a75b1a18b6edf15fa02" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc29ba49be614a75b1a18b6edf15fa02" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 33701 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f9f32b66414a45298922e22099f0c4e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39837 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1a2f04cc66ec49b5bcf7ea1771907c8a" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 40103 } health_report { overall_health: UNKNOWN } } }
W20260807 19:48:03.188083 14115 tablet.cc:2369] T 461d0d211c0141eaab36ac0542d98ab8 P fc29ba49be614a75b1a18b6edf15fa02: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:48:03.209619 14542 tablet.cc:2369] T 461d0d211c0141eaab36ac0542d98ab8 P f9f32b66414a45298922e22099f0c4e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132080, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:03.234287 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.213621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42236 (local address 127.12.155.129:33701)
0807 19:48:03.213995 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.214005 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.214593 (+ 588us) server_negotiation.cc:407] Connection header received
0807 19:48:03.214900 (+ 307us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.214906 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.215061 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.215216 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.217175 (+ 1959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.218371 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.219908 (+ 1537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.220416 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.220593 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.226323 (+ 5730us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.226352 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.226377 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.226445 (+ 68us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.230874 (+ 4429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.231703 (+ 829us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.231712 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.231715 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.231970 (+ 255us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.232381 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.232386 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.232388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.232949 (+ 561us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.233326 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.233500 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.233808 (+ 308us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132083, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132083, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:03.304672 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.285427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42252 (local address 127.12.155.129:33701)
0807 19:48:03.285713 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.285724 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.286174 (+ 450us) server_negotiation.cc:407] Connection header received
0807 19:48:03.286475 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.286480 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.286572 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.286699 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.288453 (+ 1754us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.289309 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.290853 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.291344 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.291499 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.296994 (+ 5495us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.297002 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.297006 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.297077 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.300956 (+ 3879us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.301921 (+ 965us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.301927 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.301930 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.302174 (+ 244us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.302718 (+ 544us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.302725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.302730 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.303118 (+ 388us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.303516 (+ 398us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.303845 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.304150 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
W20260807 19:48:03.336937 14329 tablet.cc:2369] T 461d0d211c0141eaab36ac0542d98ab8 P 1a2f04cc66ec49b5bcf7ea1771907c8a: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:03.375169 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.355494 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42256 (local address 127.12.155.129:33701)
0807 19:48:03.355876 (+ 382us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.355886 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.356353 (+ 467us) server_negotiation.cc:407] Connection header received
0807 19:48:03.356655 (+ 302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.356660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.356775 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.356913 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.358785 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.359715 (+ 930us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.361227 (+ 1512us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.361761 (+ 534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.361926 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.367896 (+ 5970us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.367904 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.367908 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.367966 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.371700 (+ 3734us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.372723 (+ 1023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.372733 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.372737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.372950 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.373423 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.373427 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.373429 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.373779 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.374029 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.374505 (+ 476us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.374811 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
W20260807 19:48:03.377496 13992 tablet_service.cc:2908] Rejecting scan request for tablet 461d0d211c0141eaab36ac0542d98ab8: Uninitialized: clean time has not yet been initialized
I20260807 19:48:03.381850 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13926
I20260807 19:48:03.399140 14566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.383159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42270 (local address 127.12.155.129:33701)
0807 19:48:03.383437 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.383448 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.383839 (+ 391us) server_negotiation.cc:407] Connection header received
0807 19:48:03.384030 (+ 191us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.384034 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.384161 (+ 127us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.384312 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.385910 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.386848 (+ 938us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.388311 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.388962 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.389085 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.392087 (+ 3002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.392094 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.392098 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.392146 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.395852 (+ 3706us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.396656 (+ 804us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.396661 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.396664 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.396899 (+ 235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.397310 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.397314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.397316 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.397628 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.397932 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.398276 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.398653 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 19:48:03.400033 14108 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:03.506399 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13926
I20260807 19:48:03.539285 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14122
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:03.557168 14570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.540386 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43554 (local address 127.12.155.130:40103)
0807 19:48:03.540629 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.540635 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.540657 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:48:03.540834 (+ 177us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.540839 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.540931 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.541028 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.542597 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.543520 (+ 923us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.544897 (+ 1377us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.545396 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.545524 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.550317 (+ 4793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.550340 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.550364 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.550410 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.553792 (+ 3382us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.554721 (+ 929us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.554730 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.554732 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.554892 (+ 160us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.555356 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.555361 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.555363 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.555834 (+ 471us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.556220 (+ 386us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.556517 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.556780 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 19:48:03.557962 14320 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:03.657269 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14122
I20260807 19:48:03.692257 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14335
Aug 07 19:48:03 dist-test-slave-2p8l krb5kdc[13759](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132083, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:03.711185 14619 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:03.693444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36890 (local address 127.12.155.131:39837)
0807 19:48:03.694123 (+ 679us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:03.694136 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:03.694156 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:48:03.694229 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:03.694234 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:03.694324 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:03.694435 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:03.695999 (+ 1564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.696826 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.698384 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:03.698868 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:03.698981 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:03.704346 (+ 5365us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:03.704370 (+ 24us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:03.704395 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:03.704438 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:03.707822 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.708597 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.708607 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.708610 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.708775 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:03.709194 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:03.709200 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:03.709203 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:03.709664 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:03.710028 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:03.710454 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 19:48:03.710744 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":374,"threads_started":1}
I20260807 19:48:03.712270 14533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:03.813048 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14335
I20260807 19:48:03.846603 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13782
I20260807 19:48:03.848340 13880 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:03.976778 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13782
2026-08-07T19:48:04Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizationOnChecksum (5236 ms)
[ RUN ] SecurityITest.SmokeTestAsAuthorizedUser
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:04 dist-test-slave-2p8l krb5kdc[14624](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:04 dist-test-slave-2p8l krb5kdc[14624](info): set up 2 sockets
Aug 07 19:48:04 dist-test-slave-2p8l krb5kdc[14624](info): commencing operation
krb5kdc: starting...
W20260807 19:48:05.406786 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.366s user 0.002s sys 0.027s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:05 dist-test-slave-2p8l krb5kdc[14624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:05.659040 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:44737
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:44737
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:06.062813 14641 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:06.063283 14641 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:06.063467 14641 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:06.071630 14641 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:06.071806 14641 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 19:48:06.071913 14641 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:06.072036 14641 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:06.072125 14641 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:06.072242 14641 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:06.084911 14641 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:44737
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:44737
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:06.086872 14641 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:06.088629 14641 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:06.103353 14646 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:06.103461 14650 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:06.103408 14648 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:06.104894 14641 server_base.cc:1034] running on GCE node
I20260807 19:48:06.105901 14641 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:06.107717 14641 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:06.108963 14641 hybrid_clock.cc:648] HybridClock initialized: now 1786132086108874 us; error 50 us; skew 500 ppm
I20260807 19:48:06.109386 14641 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:06 dist-test-slave-2p8l krb5kdc[14624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132086, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:06.113323 14641 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:06.115342 14641 webserver.cc:460] Webserver started at http://127.12.155.190:46093/ using document root <none> and password file <none>
I20260807 19:48:06.116272 14641 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:06.116375 14641 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:06.116803 14641 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:06.120723 14641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "48262c3b238d48988a8d362b51263dab"
format_stamp: "Formatted at 2026-08-07 19:48:06 on dist-test-slave-2p8l"
server_key: "7426bbe74c09f85b063f15e3f3f040b1"
server_key_iv: "f1e1f364b68eb6bc64466ae0463083f6"
server_key_version: "encryptionkey@0"
I20260807 19:48:06.121713 14641 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "48262c3b238d48988a8d362b51263dab"
format_stamp: "Formatted at 2026-08-07 19:48:06 on dist-test-slave-2p8l"
server_key: "7426bbe74c09f85b063f15e3f3f040b1"
server_key_iv: "f1e1f364b68eb6bc64466ae0463083f6"
server_key_version: "encryptionkey@0"
I20260807 19:48:06.128474 14641 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:06.132885 14667 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:06.134771 14641 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:06.135011 14641 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "48262c3b238d48988a8d362b51263dab"
format_stamp: "Formatted at 2026-08-07 19:48:06 on dist-test-slave-2p8l"
server_key: "7426bbe74c09f85b063f15e3f3f040b1"
server_key_iv: "f1e1f364b68eb6bc64466ae0463083f6"
server_key_version: "encryptionkey@0"
I20260807 19:48:06.135337 14641 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:06.153999 14641 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:06.159533 14641 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:06.159889 14641 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:06.186805 14641 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:44737
I20260807 19:48:06.186872 14762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:44737 every 8 connection(s)
I20260807 19:48:06.188649 14641 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:06.193724 14763 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:06.198899 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14641
I20260807 19:48:06.199206 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:06.200182 12910 external_mini_cluster.cc:1428] Setting key 5e0c91cd6623d2712c153fc9d9da6a9b
I20260807 19:48:06.208244 14763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: Bootstrap starting.
I20260807 19:48:06.212849 14763 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:06.214418 14763 log.cc:824] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:48:06 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132085, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:06.218420 14763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: No bootstrap required, opened a new log
I20260807 19:48:06.227552 14766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:06.202867 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58434 (local address 127.12.155.190:44737)
0807 19:48:06.203794 (+ 927us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:06.203809 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:06.203860 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:48:06.206232 (+ 2372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:06.206265 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:06.206738 (+ 473us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:06.207136 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:06.209148 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.210736 (+ 1588us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.212661 (+ 1925us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.213529 (+ 868us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.213678 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:06.219095 (+ 5417us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:06.219105 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:06.219124 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:06.219165 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:06.222758 (+ 3593us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:06.223531 (+ 773us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:06.223538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:06.223549 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:06.223749 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:06.224182 (+ 433us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:06.224190 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:06.224198 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:06.224873 (+ 675us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:06.225261 (+ 388us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:06.225746 (+ 485us) server_negotiation.cc:299] Negotiation successful
0807 19:48:06.226304 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":681,"thread_start_us":446,"threads_started":1}
I20260807 19:48:06.227511 14763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48262c3b238d48988a8d362b51263dab" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44737 } }
I20260807 19:48:06.228050 14763 raft_consensus.cc:374] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:06.228195 14763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 48262c3b238d48988a8d362b51263dab, State: Initialized, Role: FOLLOWER
I20260807 19:48:06.228928 14763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48262c3b238d48988a8d362b51263dab" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44737 } }
I20260807 19:48:06.229230 14763 raft_consensus.cc:388] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:06.229430 14763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:06.229651 14763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:06.232528 14763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48262c3b238d48988a8d362b51263dab" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44737 } }
I20260807 19:48:06.233132 14763 leader_election.cc:302] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 48262c3b238d48988a8d362b51263dab; no voters:
I20260807 19:48:06.233819 14763 leader_election.cc:288] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:06.233983 14768 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:06.234823 14768 raft_consensus.cc:686] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [term 1 LEADER]: Becoming Leader. State: Replica: 48262c3b238d48988a8d362b51263dab, State: Running, Role: LEADER
I20260807 19:48:06.235625 14768 consensus_queue.cc:237] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48262c3b238d48988a8d362b51263dab" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44737 } }
I20260807 19:48:06.236632 14763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:06.239293 14769 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "48262c3b238d48988a8d362b51263dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48262c3b238d48988a8d362b51263dab" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44737 } } }
I20260807 19:48:06.239485 14771 sys_catalog.cc:455] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [sys.catalog]: SysCatalogTable state changed. Reason: New leader 48262c3b238d48988a8d362b51263dab. Latest consensus state: current_term: 1 leader_uuid: "48262c3b238d48988a8d362b51263dab" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "48262c3b238d48988a8d362b51263dab" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44737 } } }
I20260807 19:48:06.239802 14769 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:06.239804 14771 sys_catalog.cc:458] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:06.242650 14781 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:06.248168 14781 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:06.258293 14781 catalog_manager.cc:1347] Generated new cluster ID: 1dce74a2fa9746a1b67bf7369012e604
I20260807 19:48:06.258445 14781 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:06.286268 14781 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:06.288005 14781 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:06.300216 14781 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: Generated new TSK 0
I20260807 19:48:06.301302 14781 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:06.369823 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44737
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:06.788556 14802 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:06.789067 14802 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:06.789202 14802 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:06.797811 14802 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:06.797988 14802 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:06.798123 14802 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:48:06.798228 14802 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:06.810395 14802 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:44737
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:06.812388 14802 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:06.814242 14802 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:06.831527 14816 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:06.831527 14819 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:06.832376 14813 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:06.832372 14802 server_base.cc:1034] running on GCE node
I20260807 19:48:06.833344 14802 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:06.834609 14802 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:06.835901 14802 hybrid_clock.cc:648] HybridClock initialized: now 1786132086835816 us; error 49 us; skew 500 ppm
I20260807 19:48:06.836339 14802 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:06 dist-test-slave-2p8l krb5kdc[14624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132086, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:06.840473 14802 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:06.842432 14802 webserver.cc:460] Webserver started at http://127.12.155.129:38281/ using document root <none> and password file <none>
I20260807 19:48:06.843328 14802 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:06.843429 14802 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:06.843804 14802 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:06.847489 14802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d"
format_stamp: "Formatted at 2026-08-07 19:48:06 on dist-test-slave-2p8l"
server_key: "99111c21c75869e50108f9ca1e26f7d5"
server_key_iv: "25272d60878d27598ceb76ecd02c2206"
server_key_version: "encryptionkey@0"
I20260807 19:48:06.848431 14802 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d"
format_stamp: "Formatted at 2026-08-07 19:48:06 on dist-test-slave-2p8l"
server_key: "99111c21c75869e50108f9ca1e26f7d5"
server_key_iv: "25272d60878d27598ceb76ecd02c2206"
server_key_version: "encryptionkey@0"
I20260807 19:48:06.855141 14802 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:48:06.859704 14834 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:06.861503 14802 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:48:06.861719 14802 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d"
format_stamp: "Formatted at 2026-08-07 19:48:06 on dist-test-slave-2p8l"
server_key: "99111c21c75869e50108f9ca1e26f7d5"
server_key_iv: "25272d60878d27598ceb76ecd02c2206"
server_key_version: "encryptionkey@0"
I20260807 19:48:06.862020 14802 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:06.876891 14802 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:06.881973 14802 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:06.882330 14802 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:06.885653 14802 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:06.885771 14802 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:06.885906 14802 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:06.885999 14802 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:48:06 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132086, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:06.917688 14849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:06.886517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:55915 (local address 127.12.155.190:44737)
0807 19:48:06.887191 (+ 674us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:06.887197 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:06.888736 (+ 1539us) server_negotiation.cc:407] Connection header received
0807 19:48:06.891204 (+ 2468us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:06.891213 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:06.891350 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:06.891501 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:06.894538 (+ 3037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.895784 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.899193 (+ 3409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.900086 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.900278 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:06.907179 (+ 6901us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:06.907185 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:06.907189 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:06.907241 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:06.911805 (+ 4564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:06.913306 (+ 1501us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:06.913317 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:06.913322 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:06.913536 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:06.914344 (+ 808us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:06.914353 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:06.914356 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:06.914841 (+ 485us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:06.915062 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:06.916717 (+ 1655us) server_negotiation.cc:299] Negotiation successful
0807 19:48:06.917112 (+ 395us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":527,"thread_start_us":391,"threads_started":1}
I20260807 19:48:06.919838 14850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:06.887375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.12.155.129:55915)
0807 19:48:06.888526 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:06.888576 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:06.890836 (+ 2260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:06.891865 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:06.891882 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:06.892967 (+ 1085us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:06.894287 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:06.894313 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.896014 (+ 1701us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.896025 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:06.898985 (+ 2960us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:06.899009 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.900434 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.900445 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:06.900887 (+ 442us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:06.902111 (+ 1224us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:06.902161 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:06.906785 (+ 4624us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:06.912041 (+ 5256us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:06.912060 (+ 19us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:06.912101 (+ 41us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:06.913111 (+ 1010us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:06.913716 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:06.913724 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:06.913730 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:06.914169 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:06.915177 (+ 1008us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:06.915191 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:06.916006 (+ 815us) client_negotiation.cc:769] Sending connection context
0807 19:48:06.916524 (+ 518us) client_negotiation.cc:240] Negotiation successful
0807 19:48:06.917493 (+ 969us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":747,"thread_start_us":496,"threads_started":1}
I20260807 19:48:06.931447 14802 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:45197
I20260807 19:48:06.931476 15033 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:45197 every 8 connection(s)
I20260807 19:48:06.933497 14802 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:06.936496 15034 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44737
I20260807 19:48:06.937361 15034 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:06.938526 15034 heartbeater.cc:511] Master 127.12.155.190:44737 requested a full tablet report, sending...
I20260807 19:48:06.940035 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14802
I20260807 19:48:06.940348 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:06.941274 12910 external_mini_cluster.cc:1428] Setting key b33b360bed7243cf2b22d3e0340cddff
I20260807 19:48:06.941962 14693 ts_manager.cc:194] Registered new tserver with Master: 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197)
I20260807 19:48:06.944648 14693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:55915
I20260807 19:48:06.947883 14849 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:06.930184 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51113 (local address 127.12.155.190:44737)
0807 19:48:06.930402 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:06.930407 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:06.931745 (+ 1338us) server_negotiation.cc:407] Connection header received
0807 19:48:06.931909 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:06.931916 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:06.932038 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:06.932167 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:06.933327 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.934402 (+ 1075us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.936360 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.937224 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.937412 (+ 188us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:06.940315 (+ 2903us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:06.940326 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:06.940336 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:06.940385 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:06.944477 (+ 4092us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:06.945415 (+ 938us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:06.945425 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:06.945440 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:06.945639 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:06.946188 (+ 549us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:06.946195 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:06.946201 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:06.946553 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:06.946663 (+ 110us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:06.947214 (+ 551us) server_negotiation.cc:299] Negotiation successful
0807 19:48:06.947474 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:48:06.947999 15031 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:06.930377 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.12.155.129:51113)
0807 19:48:06.931475 (+ 1098us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:06.931497 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:06.931740 (+ 243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:06.932195 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:06.932200 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:06.932777 (+ 577us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:06.933147 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:06.933160 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.934595 (+ 1435us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.934601 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:06.936176 (+ 1575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:06.936195 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:06.937511 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:06.937523 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:06.937725 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:06.938746 (+ 1021us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:06.938773 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:06.940060 (+ 1287us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:06.944672 (+ 4612us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:06.944678 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:06.944683 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:06.945263 (+ 580us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:06.945834 (+ 571us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:06.945838 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:06.945841 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:06.946006 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:06.946746 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:06.946750 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:06.946941 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 19:48:06.947097 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 19:48:06.947496 (+ 399us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":838,"thread_start_us":615,"threads_started":1}
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:07.001905 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44737
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:07.417059 15040 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:07.417534 15040 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:07.417734 15040 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:07.425993 15040 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:07.426191 15040 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:07.426367 15040 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:48:07.426527 15040 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:07.438704 15040 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:44737
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:07.440703 15040 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:07.442692 15040 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:07.459055 15054 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:07.459179 15050 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:07.459637 15051 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:07.460251 15040 server_base.cc:1034] running on GCE node
I20260807 19:48:07.461069 15040 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:07.462363 15040 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:07.463675 15040 hybrid_clock.cc:648] HybridClock initialized: now 1786132087463578 us; error 59 us; skew 500 ppm
I20260807 19:48:07.464190 15040 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:07 dist-test-slave-2p8l krb5kdc[14624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132087, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:07.468547 15040 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:07.470541 15040 webserver.cc:460] Webserver started at http://127.12.155.130:33551/ using document root <none> and password file <none>
I20260807 19:48:07.471539 15040 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:07.471698 15040 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:07.472149 15040 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:07.476389 15040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "3c525670e3cf4b53bc3e0f85f7f04c46"
format_stamp: "Formatted at 2026-08-07 19:48:07 on dist-test-slave-2p8l"
server_key: "9e551704f6c4d21fc3153b2ace483a34"
server_key_iv: "f4d6b9d8aaa46e91fcab21e0739c2bb8"
server_key_version: "encryptionkey@0"
I20260807 19:48:07.477469 15040 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "3c525670e3cf4b53bc3e0f85f7f04c46"
format_stamp: "Formatted at 2026-08-07 19:48:07 on dist-test-slave-2p8l"
server_key: "9e551704f6c4d21fc3153b2ace483a34"
server_key_iv: "f4d6b9d8aaa46e91fcab21e0739c2bb8"
server_key_version: "encryptionkey@0"
I20260807 19:48:07.484362 15040 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 19:48:07.488767 15071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:07.490532 15040 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:48:07.490765 15040 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "3c525670e3cf4b53bc3e0f85f7f04c46"
format_stamp: "Formatted at 2026-08-07 19:48:07 on dist-test-slave-2p8l"
server_key: "9e551704f6c4d21fc3153b2ace483a34"
server_key_iv: "f4d6b9d8aaa46e91fcab21e0739c2bb8"
server_key_version: "encryptionkey@0"
I20260807 19:48:07.491070 15040 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:07.514212 15040 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:07.520421 15040 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:07.520828 15040 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:07.524742 15040 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:07.524874 15040 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:07.525046 15040 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:07.525146 15040 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:48:07 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132087, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:07.554838 15091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:07.525488 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:41619 (local address 127.12.155.190:44737)
0807 19:48:07.526542 (+ 1054us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:07.526547 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:07.527706 (+ 1159us) server_negotiation.cc:407] Connection header received
0807 19:48:07.530053 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:07.530079 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:07.530207 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:07.530353 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:07.532751 (+ 2398us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.534005 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.536948 (+ 2943us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.537893 (+ 945us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.539413 (+ 1520us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:07.544974 (+ 5561us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:07.544986 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:07.544995 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:07.545071 (+ 76us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:07.549544 (+ 4473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:07.550943 (+ 1399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:07.550948 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:07.550951 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:07.551120 (+ 169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:07.551861 (+ 741us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:07.551866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:07.551868 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:07.552310 (+ 442us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:07.552532 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:07.554031 (+ 1499us) server_negotiation.cc:299] Negotiation successful
0807 19:48:07.554447 (+ 416us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":894,"thread_start_us":754,"threads_started":1}
I20260807 19:48:07.557567 15093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:07.526442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.12.155.130:41619)
0807 19:48:07.527497 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:07.527548 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:07.529697 (+ 2149us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:07.530632 (+ 935us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:07.530641 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:07.531419 (+ 778us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:07.532537 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:07.532562 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.534213 (+ 1651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.534222 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:07.536678 (+ 2456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:07.536699 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.538368 (+ 1669us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.538377 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:07.538722 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:07.540006 (+ 1284us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:07.540069 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:07.544593 (+ 4524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:07.549757 (+ 5164us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:07.549773 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:07.549805 (+ 32us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:07.550759 (+ 954us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:07.551275 (+ 516us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:07.551283 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:07.551287 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:07.551698 (+ 411us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:07.552519 (+ 821us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:07.552540 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:07.553420 (+ 880us) client_negotiation.cc:769] Sending connection context
0807 19:48:07.553925 (+ 505us) client_negotiation.cc:240] Negotiation successful
0807 19:48:07.554972 (+ 1047us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":452,"threads_started":1}
I20260807 19:48:07.583004 15202 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:07.565277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.12.155.130:38269)
0807 19:48:07.566179 (+ 902us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:07.566212 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:07.566442 (+ 230us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:07.566866 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:07.566871 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:07.567700 (+ 829us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:07.568235 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:07.568255 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.570274 (+ 2019us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.570282 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:07.571965 (+ 1683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:07.571979 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.572847 (+ 868us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.572854 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:07.573026 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:07.573908 (+ 882us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:07.573928 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:07.575180 (+ 1252us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:07.578931 (+ 3751us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:07.578941 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:07.578953 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:07.579921 (+ 968us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:07.580527 (+ 606us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:07.580533 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:07.580537 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:07.580781 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:07.581661 (+ 880us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:07.581666 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:07.581875 (+ 209us) client_negotiation.cc:769] Sending connection context
0807 19:48:07.582022 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 19:48:07.582426 (+ 404us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":622,"thread_start_us":472,"threads_started":1}
I20260807 19:48:07.583118 15091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:07.565307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:38269 (local address 127.12.155.190:44737)
0807 19:48:07.565612 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:07.565622 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:07.566346 (+ 724us) server_negotiation.cc:407] Connection header received
0807 19:48:07.566619 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:07.566625 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:07.566702 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:07.566832 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:07.568454 (+ 1622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.570083 (+ 1629us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.572166 (+ 2083us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:07.572626 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:07.572784 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:07.575407 (+ 2623us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:07.575412 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:07.575415 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:07.575454 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:07.578744 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:07.580184 (+ 1440us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:07.580193 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:07.580198 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:07.580388 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:07.580941 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:07.580947 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:07.580950 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:07.581509 (+ 559us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:07.581734 (+ 225us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:07.582236 (+ 502us) server_negotiation.cc:299] Negotiation successful
0807 19:48:07.582565 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 19:48:07.592319 15040 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:41675
I20260807 19:48:07.592340 15291 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:41675 every 8 connection(s)
I20260807 19:48:07.593930 15040 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:07.596503 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15040
I20260807 19:48:07.596779 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:07.596990 15294 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44737
I20260807 19:48:07.597272 15294 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:07.597497 12910 external_mini_cluster.cc:1428] Setting key b47f3d2edceef835e93f1100e462101e
I20260807 19:48:07.598330 15294 heartbeater.cc:511] Master 127.12.155.190:44737 requested a full tablet report, sending...
I20260807 19:48:07.600129 14693 ts_manager.cc:194] Registered new tserver with Master: 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675)
I20260807 19:48:07.601064 14693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:41619
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:07.657358 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44737
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41209
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:07.950421 15034 heartbeater.cc:503] Master 127.12.155.190:44737 was elected leader, sending a full tablet report...
W20260807 19:48:08.086229 15300 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:08.086690 15300 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:08.086900 15300 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:08.095356 15300 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:08.095569 15300 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:08.095745 15300 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:48:08.095932 15300 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:08.107892 15300 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41209
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:44737
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:08.109691 15300 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:08.111594 15300 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:08.128743 15306 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:08.128813 15311 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:08.128858 15308 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:08.130378 15300 server_base.cc:1034] running on GCE node
I20260807 19:48:08.131321 15300 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:08.132625 15300 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:08.133955 15300 hybrid_clock.cc:648] HybridClock initialized: now 1786132088133864 us; error 45 us; skew 500 ppm
I20260807 19:48:08.134374 15300 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:08 dist-test-slave-2p8l krb5kdc[14624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:08.138450 15300 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:08.140586 15300 webserver.cc:460] Webserver started at http://127.12.155.131:32951/ using document root <none> and password file <none>
I20260807 19:48:08.141549 15300 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:08.141673 15300 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:08.142123 15300 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:08.145840 15300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "f5e9ee4227a54d4d81f6cb230100fe06"
format_stamp: "Formatted at 2026-08-07 19:48:08 on dist-test-slave-2p8l"
server_key: "b21a7d55da278877affe66117599a8f5"
server_key_iv: "b022be535bb8ad32a33f4d1443fe0b7c"
server_key_version: "encryptionkey@0"
I20260807 19:48:08.146806 15300 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "f5e9ee4227a54d4d81f6cb230100fe06"
format_stamp: "Formatted at 2026-08-07 19:48:08 on dist-test-slave-2p8l"
server_key: "b21a7d55da278877affe66117599a8f5"
server_key_iv: "b022be535bb8ad32a33f4d1443fe0b7c"
server_key_version: "encryptionkey@0"
I20260807 19:48:08.152980 15300 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:08.157156 15318 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:08.158835 15300 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:08.158993 15300 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "f5e9ee4227a54d4d81f6cb230100fe06"
format_stamp: "Formatted at 2026-08-07 19:48:08 on dist-test-slave-2p8l"
server_key: "b21a7d55da278877affe66117599a8f5"
server_key_iv: "b022be535bb8ad32a33f4d1443fe0b7c"
server_key_version: "encryptionkey@0"
I20260807 19:48:08.159206 15300 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:08.182899 15300 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:08.188982 15300 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:08.189321 15300 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:08.193300 15300 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:08.193423 15300 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:08.193602 15300 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:08.193712 15300 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:48:08 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:08.228993 15336 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.194836 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.12.155.131:39983)
0807 19:48:08.202439 (+ 7603us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.202538 (+ 99us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.206724 (+ 4186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.207933 (+ 1209us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.207944 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.208901 (+ 957us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:08.210032 (+ 1131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.210110 (+ 78us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.211806 (+ 1696us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.211810 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.214135 (+ 2325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.214149 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.215428 (+ 1279us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.215433 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.215649 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.216611 (+ 962us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:08.216669 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:08.219710 (+ 3041us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:08.223923 (+ 4213us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:08.223935 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:08.223959 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:08.224506 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:08.224939 (+ 433us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:08.224945 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:08.224949 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:08.225199 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:08.225812 (+ 613us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:08.225822 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:08.226420 (+ 598us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.226883 (+ 463us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.227471 (+ 588us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7151,"thread_start_us":6834,"threads_started":1}
I20260807 19:48:08.230515 15331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.193886 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:39983 (local address 127.12.155.190:44737)
0807 19:48:08.201846 (+ 7960us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.201855 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.202733 (+ 878us) server_negotiation.cc:407] Connection header received
0807 19:48:08.207198 (+ 4465us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.207204 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.207305 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.207581 (+ 276us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:08.210344 (+ 2763us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.211613 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.214311 (+ 2698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.214972 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.215114 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.219992 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:08.219998 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:08.220002 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:08.220043 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:08.223762 (+ 3719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:08.224645 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:08.224651 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:08.224655 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:08.224818 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:08.225326 (+ 508us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:08.225332 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:08.225335 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:08.225671 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:08.225858 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.229805 (+ 3947us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.230033 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7744,"thread_start_us":7548,"threads_started":1}
I20260807 19:48:08.256549 15331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.240556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:37097 (local address 127.12.155.190:44737)
0807 19:48:08.240867 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.240896 (+ 29us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.240929 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:48:08.241162 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.241169 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.241257 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.241377 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:08.242646 (+ 1269us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.243496 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.245014 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.245506 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.245658 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.248563 (+ 2905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:08.248574 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:08.248582 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:08.248641 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:08.252629 (+ 3988us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:08.253502 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:08.253510 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:08.253514 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:08.253733 (+ 219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:08.254391 (+ 658us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:08.254398 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:08.254403 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:08.254936 (+ 533us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:08.255472 (+ 536us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.255816 (+ 344us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.256100 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:48:08.256636 15454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.239981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.12.155.131:37097)
0807 19:48:08.240734 (+ 753us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.240757 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.240948 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.241404 (+ 456us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.241409 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.242050 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:08.242478 (+ 428us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.242489 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.243641 (+ 1152us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.243649 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.244860 (+ 1211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.244874 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.245737 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.245746 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.245964 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.246861 (+ 897us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:08.246897 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:08.248290 (+ 1393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:08.252813 (+ 4523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:08.252819 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:08.252824 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:08.253349 (+ 525us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:08.253897 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:08.253907 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:08.253917 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:08.254179 (+ 262us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:08.255138 (+ 959us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:08.255144 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:08.255471 (+ 327us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.255667 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.256109 (+ 442us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":552,"thread_start_us":620,"threads_started":1}
I20260807 19:48:08.265403 15300 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:43059
I20260807 19:48:08.265425 15519 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:43059 every 8 connection(s)
I20260807 19:48:08.267155 15300 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:08.269762 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15300
I20260807 19:48:08.270051 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:08.270387 15520 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44737
I20260807 19:48:08.270684 15520 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:08.270833 12910 external_mini_cluster.cc:1428] Setting key 9830577ff00da25d85d44c3b5fb382df
I20260807 19:48:08.271694 15520 heartbeater.cc:511] Master 127.12.155.190:44737 requested a full tablet report, sending...
I20260807 19:48:08.273638 14693 ts_manager.cc:194] Registered new tserver with Master: f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059)
I20260807 19:48:08.274969 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:48:08.274948 14693 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:39983
Aug 07 19:48:08 dist-test-slave-2p8l krb5kdc[14624](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:48:08 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:08.337496 15331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.320744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58442 (local address 127.12.155.190:44737)
0807 19:48:08.321065 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.321074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.321286 (+ 212us) server_negotiation.cc:407] Connection header received
0807 19:48:08.321492 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.321499 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.321647 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.321780 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:08.323453 (+ 1673us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.324450 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.325828 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.326372 (+ 544us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.326478 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.330946 (+ 4468us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:08.330952 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:08.330955 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:08.330999 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:08.334575 (+ 3576us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:08.335296 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:08.335300 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:08.335303 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:08.335456 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:08.335830 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:08.335834 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:08.335836 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:08.336163 (+ 327us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:08.336406 (+ 243us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.336823 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.337069 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":125}
I20260807 19:48:08.343907 14693 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:08.352167 14693 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:08.381543 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.371420 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54062 (local address 127.12.155.130:41675)
0807 19:48:08.373438 (+ 2018us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.373454 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.373479 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:48:08.373574 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.373579 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.373727 (+ 148us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.373961 (+ 234us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:08.374735 (+ 774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.376299 (+ 1564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.378863 (+ 2564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.380248 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.380485 (+ 237us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.380713 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.380954 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.381149 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1843,"thread_start_us":1689,"threads_started":1}
I20260807 19:48:08.381620 15550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.371277 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:41675 (local address 127.0.0.1:54062)
0807 19:48:08.372674 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.372698 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.372862 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.373924 (+ 1062us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.373929 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.373956 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:08.374491 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.374508 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.376458 (+ 1950us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.376467 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.378693 (+ 2226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.378707 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.380463 (+ 1756us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.380472 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.380656 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.380708 (+ 52us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.380894 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.381129 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1237,"mutex_wait_us":267,"thread_start_us":1062,"threads_started":1}
I20260807 19:48:08.382431 15546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.368442 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45197 (local address 127.0.0.1:49914)
0807 19:48:08.372322 (+ 3880us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.372347 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.372512 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.373622 (+ 1110us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.373626 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.373654 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:08.374205 (+ 551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.374220 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.376320 (+ 2100us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.376331 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.379139 (+ 2808us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.379154 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.381482 (+ 2328us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.381488 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.381686 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.381730 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.381822 (+ 92us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.381963 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3651,"mutex_wait_us":226,"thread_start_us":3472,"threads_started":1}
I20260807 19:48:08.382902 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.369203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49914 (local address 127.12.155.129:45197)
0807 19:48:08.369909 (+ 706us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.369920 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.372663 (+ 2743us) server_negotiation.cc:407] Connection header received
0807 19:48:08.372813 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.372826 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.373118 (+ 292us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.373344 (+ 226us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:08.374415 (+ 1071us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.376159 (+ 1744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.379342 (+ 3183us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.380913 (+ 1571us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.381108 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.381316 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.382404 (+ 1088us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.382601 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":296,"threads_started":1}
I20260807 19:48:08.383522 15545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.368216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:43059 (local address 127.0.0.1:41714)
0807 19:48:08.369030 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.369084 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.369336 (+ 252us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.372989 (+ 3653us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.372998 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.373030 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:08.373572 (+ 542us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.373591 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.376083 (+ 2492us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.376092 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.379516 (+ 3424us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.379531 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.381819 (+ 2288us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.381825 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.381995 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.382025 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.382160 (+ 135us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.382304 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":524,"mutex_wait_us":160,"thread_start_us":383,"threads_started":1}
I20260807 19:48:08.383103 15549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.369295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41714 (local address 127.12.155.131:43059)
0807 19:48:08.370267 (+ 972us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.370276 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.370317 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:48:08.370437 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.370445 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.372711 (+ 2266us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.373796 (+ 1085us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:08.374260 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.375943 (+ 1683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.379717 (+ 3774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.381249 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.381470 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.381652 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.382536 (+ 884us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.382713 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":714,"thread_start_us":503,"threads_started":1}
I20260807 19:48:08.387267 15399 tablet_service.cc:1467] Processing CreateTablet for tablet 55736e7ff30d45de9b81f6927729b38b (DEFAULT_TABLE table=test-table [id=23930f5e56b249ac8078bbc98d53bdbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:08.387167 14907 tablet_service.cc:1467] Processing CreateTablet for tablet 55736e7ff30d45de9b81f6927729b38b (DEFAULT_TABLE table=test-table [id=23930f5e56b249ac8078bbc98d53bdbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:08.388727 14907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55736e7ff30d45de9b81f6927729b38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:08.388777 15399 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55736e7ff30d45de9b81f6927729b38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:08.390336 15159 tablet_service.cc:1467] Processing CreateTablet for tablet 55736e7ff30d45de9b81f6927729b38b (DEFAULT_TABLE table=test-table [id=23930f5e56b249ac8078bbc98d53bdbd]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:08.391752 15159 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 55736e7ff30d45de9b81f6927729b38b. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:08.404874 15553 tablet_bootstrap.cc:492] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Bootstrap starting.
I20260807 19:48:08.406116 15555 tablet_bootstrap.cc:492] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Bootstrap starting.
I20260807 19:48:08.411013 15556 tablet_bootstrap.cc:492] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Bootstrap starting.
I20260807 19:48:08.411899 15555 tablet_bootstrap.cc:654] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:08.412078 15553 tablet_bootstrap.cc:654] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:08.413628 15553 log.cc:824] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:08.413628 15555 log.cc:824] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:08.414690 15556 tablet_bootstrap.cc:654] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:08.416141 15556 log.cc:824] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:08.417820 15553 tablet_bootstrap.cc:492] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: No bootstrap required, opened a new log
I20260807 19:48:08.417816 15555 tablet_bootstrap.cc:492] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: No bootstrap required, opened a new log
I20260807 19:48:08.418212 15553 ts_tablet_manager.cc:1397] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260807 19:48:08.418191 15555 ts_tablet_manager.cc:1397] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.003s
I20260807 19:48:08.419891 15556 tablet_bootstrap.cc:492] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: No bootstrap required, opened a new log
I20260807 19:48:08.420281 15556 ts_tablet_manager.cc:1397] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 19:48:08.428980 15556 raft_consensus.cc:348] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.429462 15556 raft_consensus.cc:374] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:08.429579 15556 raft_consensus.cc:729] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e9ee4227a54d4d81f6cb230100fe06, State: Initialized, Role: FOLLOWER
I20260807 19:48:08.430394 15556 consensus_queue.cc:260] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.430327 15553 raft_consensus.cc:348] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.430346 15555 raft_consensus.cc:348] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.430855 15553 raft_consensus.cc:374] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:08.430927 15555 raft_consensus.cc:374] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:08.431016 15553 raft_consensus.cc:729] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c525670e3cf4b53bc3e0f85f7f04c46, State: Initialized, Role: FOLLOWER
I20260807 19:48:08.431074 15555 raft_consensus.cc:729] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1106deee2d9b4d30a9aaac7eaa5e3f6d, State: Initialized, Role: FOLLOWER
I20260807 19:48:08.431761 15555 consensus_queue.cc:260] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.431746 15553 consensus_queue.cc:260] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.433084 15556 ts_tablet_manager.cc:1428] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Time spent starting tablet: real 0.013s user 0.010s sys 0.004s
I20260807 19:48:08.433727 15520 heartbeater.cc:503] Master 127.12.155.190:44737 was elected leader, sending a full tablet report...
I20260807 19:48:08.436074 15294 heartbeater.cc:503] Master 127.12.155.190:44737 was elected leader, sending a full tablet report...
I20260807 19:48:08.437408 15555 ts_tablet_manager.cc:1428] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Time spent starting tablet: real 0.019s user 0.013s sys 0.004s
W20260807 19:48:08.438764 15035 tablet.cc:2369] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:08.438907 15553 ts_tablet_manager.cc:1428] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Time spent starting tablet: real 0.021s user 0.010s sys 0.008s
W20260807 19:48:08.519296 15521 tablet.cc:2369] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:48:08.596738 15296 tablet.cc:2369] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:08.728029 15567 raft_consensus.cc:482] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:08.728588 15567 raft_consensus.cc:504] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.731240 15567 leader_election.cc:288] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059), 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197)
I20260807 19:48:08.741536 15549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.731691 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:45725 (local address 127.12.155.131:43059)
0807 19:48:08.732042 (+ 351us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.732053 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.733838 (+ 1785us) server_negotiation.cc:407] Connection header received
0807 19:48:08.734150 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.734155 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.734231 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.734339 (+ 108us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:08.735129 (+ 790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.735962 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.738484 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.739727 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.739940 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.740041 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.740800 (+ 759us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.741168 (+ 368us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":117}
I20260807 19:48:08.741600 15568 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.731576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45197 (local address 127.12.155.130:49405)
0807 19:48:08.733500 (+ 1924us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.733527 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.733812 (+ 285us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.734317 (+ 505us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.734329 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.734357 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:08.735154 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.735166 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.736362 (+ 1196us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.736367 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.738510 (+ 2143us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.738526 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.740307 (+ 1781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.740312 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.740523 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.740644 (+ 121us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.740757 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.741008 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1759,"mutex_wait_us":140,"thread_start_us":1457,"threads_started":1}
I20260807 19:48:08.741671 15569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.731739 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:43059 (local address 127.12.155.130:45725)
0807 19:48:08.733689 (+ 1950us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:08.733709 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:08.733894 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:08.734352 (+ 458us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:08.734356 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:08.734380 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:08.734946 (+ 566us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.734957 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.736105 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.736113 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.738209 (+ 2096us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:08.738223 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.740270 (+ 2047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.740279 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:08.740526 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.740644 (+ 118us) client_negotiation.cc:769] Sending connection context
0807 19:48:08.740762 (+ 118us) client_negotiation.cc:240] Negotiation successful
0807 19:48:08.741008 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1805,"mutex_wait_us":110,"thread_start_us":1613,"threads_started":1}
I20260807 19:48:08.742561 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.732132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:49405 (local address 127.12.155.129:45197)
0807 19:48:08.732395 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.732404 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.733673 (+ 1269us) server_negotiation.cc:407] Connection header received
0807 19:48:08.734018 (+ 345us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.734024 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.734185 (+ 161us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.734295 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:08.735334 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.736125 (+ 791us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.738760 (+ 2635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.740050 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.740251 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.740337 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.742106 (+ 1769us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.742253 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 19:48:08.743113 15446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55736e7ff30d45de9b81f6927729b38b" candidate_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" is_pre_election: true
I20260807 19:48:08.743793 15446 raft_consensus.cc:2454] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c525670e3cf4b53bc3e0f85f7f04c46 in term 0.
I20260807 19:48:08.743854 14951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55736e7ff30d45de9b81f6927729b38b" candidate_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" is_pre_election: true
I20260807 19:48:08.744619 15073 leader_election.cc:302] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c525670e3cf4b53bc3e0f85f7f04c46, f5e9ee4227a54d4d81f6cb230100fe06; no voters:
I20260807 19:48:08.744632 14951 raft_consensus.cc:2454] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 3c525670e3cf4b53bc3e0f85f7f04c46 in term 0.
I20260807 19:48:08.745174 15567 raft_consensus.cc:2781] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:08.745402 15567 raft_consensus.cc:482] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:08.745548 15567 raft_consensus.cc:3037] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:08.748488 15567 raft_consensus.cc:504] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.749250 15567 leader_election.cc:288] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [CANDIDATE]: Term 1 election: Requested vote from peers f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059), 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197)
I20260807 19:48:08.749969 14951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55736e7ff30d45de9b81f6927729b38b" candidate_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d"
I20260807 19:48:08.749974 15446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "55736e7ff30d45de9b81f6927729b38b" candidate_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e9ee4227a54d4d81f6cb230100fe06"
I20260807 19:48:08.750310 15446 raft_consensus.cc:3037] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:08.750305 14951 raft_consensus.cc:3037] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:08.752931 15446 raft_consensus.cc:2454] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c525670e3cf4b53bc3e0f85f7f04c46 in term 1.
I20260807 19:48:08.753232 14951 raft_consensus.cc:2454] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 3c525670e3cf4b53bc3e0f85f7f04c46 in term 1.
I20260807 19:48:08.753470 15073 leader_election.cc:302] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c525670e3cf4b53bc3e0f85f7f04c46, f5e9ee4227a54d4d81f6cb230100fe06; no voters:
I20260807 19:48:08.753893 15567 raft_consensus.cc:2781] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:08.754446 15567 raft_consensus.cc:686] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 LEADER]: Becoming Leader. State: Replica: 3c525670e3cf4b53bc3e0f85f7f04c46, State: Running, Role: LEADER
I20260807 19:48:08.755101 15567 consensus_queue.cc:237] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } }
I20260807 19:48:08.761498 14689 catalog_manager.cc:5495] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 reported cstate change: term changed from 0 to 1, leader changed from <none> to 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130). New cstate: current_term: 1 leader_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } health_report { overall_health: HEALTHY } } }
I20260807 19:48:08.853452 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:08.845883 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54074 (local address 127.12.155.130:41675)
0807 19:48:08.846185 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:08.846191 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:08.846771 (+ 580us) server_negotiation.cc:407] Connection header received
0807 19:48:08.847139 (+ 368us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:08.847143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:08.847247 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:08.847399 (+ 152us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:08.848035 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.848921 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.850844 (+ 1923us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:08.851285 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:08.851392 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:08.852003 (+ 611us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:08.852718 (+ 715us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:08.852843 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:08.853090 (+ 247us) server_negotiation.cc:299] Negotiation successful
0807 19:48:08.853174 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:48:08.864120 14951 raft_consensus.cc:1261] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Refusing update from remote peer 3c525670e3cf4b53bc3e0f85f7f04c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:08.864120 15446 raft_consensus.cc:1261] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Refusing update from remote peer 3c525670e3cf4b53bc3e0f85f7f04c46: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:08.865739 15570 consensus_queue.cc:1035] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:08.866297 15567 consensus_queue.cc:1035] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:08.880889 15574 mvcc.cc:205] Tried to move back new op lower bound from 7315997035973398528 to 7315997035545489408. Current Snapshot: MvccSnapshot[applied={T|T < 7315997035973398528}]
I20260807 19:48:08.905037 14689 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:08.905432 14689 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:08.910127 14689 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: Sending DeleteTablet for 3 replicas of tablet 55736e7ff30d45de9b81f6927729b38b
I20260807 19:48:08.911759 15399 tablet_service.cc:1514] Processing DeleteTablet for tablet 55736e7ff30d45de9b81f6927729b38b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:08 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:41714
I20260807 19:48:08.911772 14907 tablet_service.cc:1514] Processing DeleteTablet for tablet 55736e7ff30d45de9b81f6927729b38b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:08 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:49914
I20260807 19:48:08.911806 15159 tablet_service.cc:1514] Processing DeleteTablet for tablet 55736e7ff30d45de9b81f6927729b38b with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:08 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:54062
I20260807 19:48:08.913803 14689 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58442:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:08.914911 14689 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:08.929169 15397 tablet_service.cc:1467] Processing CreateTablet for tablet ebfdbb854ce74b2da6a25298cfba6e39 (DEFAULT_TABLE table=test-table [id=48529cac24784a28a1e3bf055041f493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:08.929702 15158 tablet_service.cc:1467] Processing CreateTablet for tablet ebfdbb854ce74b2da6a25298cfba6e39 (DEFAULT_TABLE table=test-table [id=48529cac24784a28a1e3bf055041f493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:08.930019 15397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebfdbb854ce74b2da6a25298cfba6e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:08.930554 15158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebfdbb854ce74b2da6a25298cfba6e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:08.933935 15594 tablet_replica.cc:330] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: stopping tablet replica
I20260807 19:48:08.934700 15596 tablet_replica.cc:330] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: stopping tablet replica
I20260807 19:48:08.936062 15594 raft_consensus.cc:2229] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:08.936553 15596 raft_consensus.cc:2229] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:08.937465 15594 raft_consensus.cc:2258] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:08.938210 14906 tablet_service.cc:1467] Processing CreateTablet for tablet ebfdbb854ce74b2da6a25298cfba6e39 (DEFAULT_TABLE table=test-table [id=48529cac24784a28a1e3bf055041f493]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:08.938849 14906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ebfdbb854ce74b2da6a25298cfba6e39. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:08.939129 15595 tablet_replica.cc:330] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: stopping tablet replica
I20260807 19:48:08.939669 15595 raft_consensus.cc:2229] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:08.940376 15595 raft_consensus.cc:2258] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:08.941668 15594 ts_tablet_manager.cc:1905] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:08.943058 15595 ts_tablet_manager.cc:1905] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:08.950947 15594 ts_tablet_manager.cc:1918] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:08.951464 15594 log.cc:1196] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/55736e7ff30d45de9b81f6927729b38b
I20260807 19:48:08.951561 15595 ts_tablet_manager.cc:1918] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:08.951792 15595 log.cc:1196] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/55736e7ff30d45de9b81f6927729b38b
I20260807 19:48:08.952455 15595 ts_tablet_manager.cc:1939] T 55736e7ff30d45de9b81f6927729b38b P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Deleting consensus metadata
I20260807 19:48:08.952725 15594 ts_tablet_manager.cc:1939] T 55736e7ff30d45de9b81f6927729b38b P f5e9ee4227a54d4d81f6cb230100fe06: Deleting consensus metadata
I20260807 19:48:08.939033 15596 raft_consensus.cc:2258] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:08.956169 14670 catalog_manager.cc:4841] TS 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197): tablet 55736e7ff30d45de9b81f6927729b38b (table test-table [id=23930f5e56b249ac8078bbc98d53bdbd]) successfully deleted
I20260807 19:48:08.958500 15596 ts_tablet_manager.cc:1905] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:08.961380 14669 catalog_manager.cc:4841] TS f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059): tablet 55736e7ff30d45de9b81f6927729b38b (table test-table [id=23930f5e56b249ac8078bbc98d53bdbd]) successfully deleted
I20260807 19:48:08.961799 15597 tablet_bootstrap.cc:492] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Bootstrap starting.
I20260807 19:48:08.964277 15597 tablet_bootstrap.cc:654] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:08.976241 15596 ts_tablet_manager.cc:1918] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:08.976694 15596 log.cc:1196] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/55736e7ff30d45de9b81f6927729b38b
I20260807 19:48:08.977662 15596 ts_tablet_manager.cc:1939] T 55736e7ff30d45de9b81f6927729b38b P 3c525670e3cf4b53bc3e0f85f7f04c46: Deleting consensus metadata
I20260807 19:48:08.978878 15599 tablet_bootstrap.cc:492] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Bootstrap starting.
I20260807 19:48:08.981423 15599 tablet_bootstrap.cc:654] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:08.981925 15597 tablet_bootstrap.cc:492] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: No bootstrap required, opened a new log
I20260807 19:48:08.982167 15597 ts_tablet_manager.cc:1397] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Time spent bootstrapping tablet: real 0.021s user 0.004s sys 0.006s
I20260807 19:48:08.982314 15603 tablet_bootstrap.cc:492] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Bootstrap starting.
I20260807 19:48:08.982303 14672 catalog_manager.cc:4841] TS 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675): tablet 55736e7ff30d45de9b81f6927729b38b (table test-table [id=23930f5e56b249ac8078bbc98d53bdbd]) successfully deleted
I20260807 19:48:08.983331 15597 raft_consensus.cc:348] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:08.983695 15597 raft_consensus.cc:374] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:08.983814 15597 raft_consensus.cc:729] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1106deee2d9b4d30a9aaac7eaa5e3f6d, State: Initialized, Role: FOLLOWER
I20260807 19:48:08.984401 15603 tablet_bootstrap.cc:654] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:08.984277 15597 consensus_queue.cc:260] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:08.985239 15597 ts_tablet_manager.cc:1428] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 19:48:08.987608 15603 tablet_bootstrap.cc:492] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: No bootstrap required, opened a new log
I20260807 19:48:08.987777 15603 ts_tablet_manager.cc:1397] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Time spent bootstrapping tablet: real 0.006s user 0.003s sys 0.000s
I20260807 19:48:08.989061 15603 raft_consensus.cc:348] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:08.989464 15603 raft_consensus.cc:374] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:08.989614 15603 raft_consensus.cc:729] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c525670e3cf4b53bc3e0f85f7f04c46, State: Initialized, Role: FOLLOWER
I20260807 19:48:08.989908 15603 consensus_queue.cc:260] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:08.990692 15603 ts_tablet_manager.cc:1428] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:08.992820 15599 tablet_bootstrap.cc:492] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: No bootstrap required, opened a new log
I20260807 19:48:08.993093 15599 ts_tablet_manager.cc:1397] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.005s
I20260807 19:48:08.994235 15599 raft_consensus.cc:348] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:08.994619 15599 raft_consensus.cc:374] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:08.994853 15599 raft_consensus.cc:729] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e9ee4227a54d4d81f6cb230100fe06, State: Initialized, Role: FOLLOWER
I20260807 19:48:08.995352 15599 consensus_queue.cc:260] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:08.996307 15599 ts_tablet_manager.cc:1428] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 19:48:09.071112 15565 raft_consensus.cc:482] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:09.071480 15565 raft_consensus.cc:504] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.074048 15565 leader_election.cc:288] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197), 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675)
I20260807 19:48:09.085340 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.074698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:58781 (local address 127.12.155.130:41675)
0807 19:48:09.074962 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.074969 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.075704 (+ 735us) server_negotiation.cc:407] Connection header received
0807 19:48:09.076089 (+ 385us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.076096 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.076193 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.076265 (+ 72us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:09.077632 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.078772 (+ 1140us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.082395 (+ 3623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.083933 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.084143 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.084240 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.084646 (+ 406us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.084882 (+ 236us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:48:09.085440 15610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.074482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:41675 (local address 127.12.155.131:58781)
0807 19:48:09.075558 (+ 1076us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.075583 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.075875 (+ 292us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.076525 (+ 650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.076531 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.076562 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:09.077359 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.077376 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.078995 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.079011 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.082183 (+ 3172us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.082215 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.084194 (+ 1979us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.084200 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.084388 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.084424 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.084602 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.084830 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":890,"mutex_wait_us":166,"thread_start_us":623,"threads_started":1}
I20260807 19:48:09.087010 15209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebfdbb854ce74b2da6a25298cfba6e39" candidate_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" is_pre_election: true
I20260807 19:48:09.087998 15209 raft_consensus.cc:2454] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5e9ee4227a54d4d81f6cb230100fe06 in term 0.
I20260807 19:48:09.088482 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.074934 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:56783 (local address 127.12.155.129:45197)
0807 19:48:09.075239 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.075248 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.076488 (+ 1240us) server_negotiation.cc:407] Connection header received
0807 19:48:09.076757 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.076762 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.076846 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.076976 (+ 130us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:09.077850 (+ 874us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.079129 (+ 1279us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.084360 (+ 5231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.086853 (+ 2493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.087067 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.087155 (+ 88us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.087833 (+ 678us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.088041 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":118}
I20260807 19:48:09.089217 15611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.074482 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45197 (local address 127.12.155.131:56783)
0807 19:48:09.076325 (+ 1843us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.076343 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.076538 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.076998 (+ 460us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.077004 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.077039 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:09.077632 (+ 593us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.077647 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.079302 (+ 1655us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.079308 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.082195 (+ 2887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.082206 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.087170 (+ 4964us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.087193 (+ 23us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.087531 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.087592 (+ 61us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.088366 (+ 774us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.088728 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1723,"mutex_wait_us":851,"thread_start_us":617,"threads_started":1}
I20260807 19:48:09.089112 15324 leader_election.cc:302] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c525670e3cf4b53bc3e0f85f7f04c46, f5e9ee4227a54d4d81f6cb230100fe06; no voters:
I20260807 19:48:09.089743 15565 raft_consensus.cc:2781] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:09.089897 15565 raft_consensus.cc:482] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:09.090005 15565 raft_consensus.cc:3037] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:09.090328 14951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebfdbb854ce74b2da6a25298cfba6e39" candidate_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" is_pre_election: true
I20260807 19:48:09.090622 14951 raft_consensus.cc:2454] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5e9ee4227a54d4d81f6cb230100fe06 in term 0.
I20260807 19:48:09.093801 15565 raft_consensus.cc:504] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.094694 15565 leader_election.cc:288] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [CANDIDATE]: Term 1 election: Requested vote from peers 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197), 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675)
I20260807 19:48:09.095317 15209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebfdbb854ce74b2da6a25298cfba6e39" candidate_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46"
I20260807 19:48:09.095391 14951 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ebfdbb854ce74b2da6a25298cfba6e39" candidate_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d"
I20260807 19:48:09.095654 14951 raft_consensus.cc:3037] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:09.095670 15209 raft_consensus.cc:3037] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:09.098722 15209 raft_consensus.cc:2454] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5e9ee4227a54d4d81f6cb230100fe06 in term 1.
I20260807 19:48:09.099118 14951 raft_consensus.cc:2454] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5e9ee4227a54d4d81f6cb230100fe06 in term 1.
I20260807 19:48:09.099299 15324 leader_election.cc:302] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3c525670e3cf4b53bc3e0f85f7f04c46, f5e9ee4227a54d4d81f6cb230100fe06; no voters:
I20260807 19:48:09.099771 15565 raft_consensus.cc:2781] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:09.101079 15565 raft_consensus.cc:686] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 LEADER]: Becoming Leader. State: Replica: f5e9ee4227a54d4d81f6cb230100fe06, State: Running, Role: LEADER
I20260807 19:48:09.101647 15565 consensus_queue.cc:237] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.107221 14692 catalog_manager.cc:5495] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } health_report { overall_health: HEALTHY } } }
Aug 07 19:48:09 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132086, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:09.194525 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.169401 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44737 (local address 127.0.0.1:58456)
0807 19:48:09.171124 (+ 1723us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.171142 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.171368 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.171762 (+ 394us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.171766 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.172713 (+ 947us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:09.173149 (+ 436us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.173162 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.174570 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.174578 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.176500 (+ 1922us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.176517 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.177375 (+ 858us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.177383 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.177577 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.182676 (+ 5099us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:09.182712 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:09.186371 (+ 3659us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:09.191155 (+ 4784us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:09.191172 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:09.191182 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:09.191817 (+ 635us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:09.192264 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:09.192268 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:09.192272 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:09.192468 (+ 196us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:09.193218 (+ 750us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:09.193228 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:09.193445 (+ 217us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.193641 (+ 196us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.193986 (+ 345us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1578,"thread_start_us":1429,"threads_started":1}
I20260807 19:48:09.194634 15626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.169430 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58456 (local address 127.12.155.190:44737)
0807 19:48:09.170645 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.170663 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.171270 (+ 607us) server_negotiation.cc:407] Connection header received
0807 19:48:09.171522 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.171526 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.171593 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.171727 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:09.173353 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.174333 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.176677 (+ 2344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.177157 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.177285 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.186684 (+ 9399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:09.186692 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:09.186697 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:09.186807 (+ 110us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:09.190959 (+ 4152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.191951 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.191958 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.191962 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.192136 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.192580 (+ 444us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.192584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.192588 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.193039 (+ 451us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:09.193215 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.193765 (+ 550us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.194195 (+ 430us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":126,"server-negotiator.queue_time_us":931,"thread_start_us":697,"threads_started":1}
I20260807 19:48:09.203048 14692 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:58456:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 19:48:09.204713 14692 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:09.213719 14906 tablet_service.cc:1467] Processing CreateTablet for tablet e163137989134e2e8268d428e90bff2e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d35e7748c6314e4181c87790269f3ed7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:48:09.213936 15158 tablet_service.cc:1467] Processing CreateTablet for tablet e163137989134e2e8268d428e90bff2e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d35e7748c6314e4181c87790269f3ed7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:48:09.213900 15397 tablet_service.cc:1467] Processing CreateTablet for tablet e163137989134e2e8268d428e90bff2e (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=d35e7748c6314e4181c87790269f3ed7]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:48:09.214596 15397 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e163137989134e2e8268d428e90bff2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:09.214604 15158 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e163137989134e2e8268d428e90bff2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:09.214594 14906 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e163137989134e2e8268d428e90bff2e. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:09.223703 15603 tablet_bootstrap.cc:492] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: Bootstrap starting.
I20260807 19:48:09.224309 15599 tablet_bootstrap.cc:492] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: Bootstrap starting.
I20260807 19:48:09.226040 15603 tablet_bootstrap.cc:654] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:09.226188 15597 tablet_bootstrap.cc:492] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Bootstrap starting.
I20260807 19:48:09.226434 15599 tablet_bootstrap.cc:654] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:09.228559 15597 tablet_bootstrap.cc:654] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:09.236899 15597 tablet_bootstrap.cc:492] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: No bootstrap required, opened a new log
I20260807 19:48:09.237201 15597 ts_tablet_manager.cc:1397] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260807 19:48:09.237370 15603 tablet_bootstrap.cc:492] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: No bootstrap required, opened a new log
I20260807 19:48:09.237586 15603 ts_tablet_manager.cc:1397] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: Time spent bootstrapping tablet: real 0.014s user 0.007s sys 0.004s
I20260807 19:48:09.238363 15597 raft_consensus.cc:348] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.237414 15599 tablet_bootstrap.cc:492] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: No bootstrap required, opened a new log
I20260807 19:48:09.238727 15597 raft_consensus.cc:374] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:09.238816 15597 raft_consensus.cc:729] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1106deee2d9b4d30a9aaac7eaa5e3f6d, State: Initialized, Role: FOLLOWER
I20260807 19:48:09.238921 15599 ts_tablet_manager.cc:1397] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20260807 19:48:09.238692 15603 raft_consensus.cc:348] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.239204 15603 raft_consensus.cc:374] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:09.239439 15603 raft_consensus.cc:729] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3c525670e3cf4b53bc3e0f85f7f04c46, State: Initialized, Role: FOLLOWER
I20260807 19:48:09.239605 15597 consensus_queue.cc:260] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.240020 15603 consensus_queue.cc:260] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.240185 15599 raft_consensus.cc:348] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.240357 15566 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.240604 15599 raft_consensus.cc:374] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:09.240756 15599 raft_consensus.cc:729] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5e9ee4227a54d4d81f6cb230100fe06, State: Initialized, Role: FOLLOWER
I20260807 19:48:09.240818 15566 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.240597 15584 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.241091 15584 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.241055 15599 consensus_queue.cc:260] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.241696 15599 ts_tablet_manager.cc:1428] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:09.243000 15603 ts_tablet_manager.cc:1428] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20260807 19:48:09.241990 15565 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.244127 15565 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.244837 15597 ts_tablet_manager.cc:1428] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Time spent starting tablet: real 0.007s user 0.002s sys 0.000s
I20260807 19:48:09.356477 15566 raft_consensus.cc:482] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:09.356835 15566 raft_consensus.cc:504] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.359329 15566 leader_election.cc:288] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675), f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059)
I20260807 19:48:09.373353 15551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.359969 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:44531 (local address 127.12.155.130:41675)
0807 19:48:09.360299 (+ 330us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.360311 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.361159 (+ 848us) server_negotiation.cc:407] Connection header received
0807 19:48:09.361619 (+ 460us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.361630 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.361756 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.361843 (+ 87us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:09.363736 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.365460 (+ 1724us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.370573 (+ 5113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.372094 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.372337 (+ 243us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.372445 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.372807 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.372974 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 19:48:09.373378 15638 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.359785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:41675 (local address 127.12.155.129:44531)
0807 19:48:09.360996 (+ 1211us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.361029 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.361337 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.362207 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.362215 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.362254 (+ 39us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:09.363382 (+ 1128us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.363406 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.365814 (+ 2408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.365823 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.369533 (+ 3710us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.369559 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.372343 (+ 2784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.372351 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.372577 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.372625 (+ 48us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.372742 (+ 117us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.372912 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":994,"thread_start_us":10947,"threads_started":1}
I20260807 19:48:09.374761 15209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e163137989134e2e8268d428e90bff2e" candidate_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" is_pre_election: true
I20260807 19:48:09.375128 15209 raft_consensus.cc:2454] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1106deee2d9b4d30a9aaac7eaa5e3f6d in term 0.
I20260807 19:48:09.375856 14840 leader_election.cc:302] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1106deee2d9b4d30a9aaac7eaa5e3f6d, 3c525670e3cf4b53bc3e0f85f7f04c46; no voters:
I20260807 19:48:09.376428 15566 raft_consensus.cc:2781] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:09.376579 15566 raft_consensus.cc:482] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:09.376703 15566 raft_consensus.cc:3037] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:09.378690 15635 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.360041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:43059 (local address 127.12.155.129:43483)
0807 19:48:09.371120 (+ 11079us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.371152 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.371330 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.371740 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.371744 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.371771 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:09.372208 (+ 437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.372226 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.373911 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.373915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.375788 (+ 1873us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.375804 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.377681 (+ 1877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.377687 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.377893 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.377927 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.378038 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.378229 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10916,"thread_start_us":852,"threads_started":1}
I20260807 19:48:09.378872 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.360723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:43483 (local address 127.12.155.131:43059)
0807 19:48:09.370385 (+ 9662us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.370396 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.371253 (+ 857us) server_negotiation.cc:407] Connection header received
0807 19:48:09.371497 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.371503 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.371598 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.371724 (+ 126us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:09.372434 (+ 710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.373714 (+ 1280us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.375995 (+ 2281us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.377429 (+ 1434us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.377644 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.377770 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.378128 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.378315 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9409,"thread_start_us":9157,"threads_started":1}
I20260807 19:48:09.380029 15446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e163137989134e2e8268d428e90bff2e" candidate_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" is_pre_election: true
I20260807 19:48:09.380368 15446 raft_consensus.cc:2454] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1106deee2d9b4d30a9aaac7eaa5e3f6d in term 0.
I20260807 19:48:09.380265 15566 raft_consensus.cc:504] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.381127 15566 leader_election.cc:288] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [CANDIDATE]: Term 1 election: Requested vote from peers 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675), f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059)
I20260807 19:48:09.381687 15209 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e163137989134e2e8268d428e90bff2e" candidate_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46"
I20260807 19:48:09.382000 15209 raft_consensus.cc:3037] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:09.382308 15446 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e163137989134e2e8268d428e90bff2e" candidate_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5e9ee4227a54d4d81f6cb230100fe06"
I20260807 19:48:09.382519 15446 raft_consensus.cc:3037] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:09.385221 15446 raft_consensus.cc:2454] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1106deee2d9b4d30a9aaac7eaa5e3f6d in term 1.
I20260807 19:48:09.385700 14837 leader_election.cc:302] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1106deee2d9b4d30a9aaac7eaa5e3f6d, f5e9ee4227a54d4d81f6cb230100fe06; no voters:
I20260807 19:48:09.385807 15209 raft_consensus.cc:2454] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1106deee2d9b4d30a9aaac7eaa5e3f6d in term 1.
I20260807 19:48:09.386165 15566 raft_consensus.cc:2781] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:09.386674 15566 raft_consensus.cc:686] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 LEADER]: Becoming Leader. State: Replica: 1106deee2d9b4d30a9aaac7eaa5e3f6d, State: Running, Role: LEADER
I20260807 19:48:09.387156 15566 consensus_queue.cc:237] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } }
I20260807 19:48:09.390492 15640 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: TxnStatusTablet state changed. Reason: New leader 1106deee2d9b4d30a9aaac7eaa5e3f6d. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.390970 15640 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:48:09.391819 15642 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 19:48:09.392110 15642 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 19:48:09.392442 14692 catalog_manager.cc:5495] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d reported cstate change: term changed from 0 to 1, leader changed from <none> to 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129). New cstate: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } health_report { overall_health: UNKNOWN } } }
I20260807 19:48:09.451211 15627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.442345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45197 (local address 127.0.0.1:49924)
0807 19:48:09.442827 (+ 482us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.442853 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.443039 (+ 186us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.443666 (+ 627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.443673 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.443689 (+ 16us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:09.443923 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.443936 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.445574 (+ 1638us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.445584 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.447493 (+ 1909us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.447511 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.448628 (+ 1117us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.448635 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.448859 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.448963 (+ 104us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.450437 (+ 1474us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.450484 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.450607 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.450819 (+ 212us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":243}
I20260807 19:48:09.451223 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.442509 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49924 (local address 127.12.155.129:45197)
0807 19:48:09.442787 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.442796 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.442939 (+ 143us) server_negotiation.cc:407] Connection header received
0807 19:48:09.443314 (+ 375us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.443320 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.443453 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.443614 (+ 161us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:09.444099 (+ 485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.445397 (+ 1298us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.447692 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.448432 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.448563 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.449203 (+ 640us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.450299 (+ 1096us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.450464 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.450657 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.450792 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260807 19:48:09.458325 15446 raft_consensus.cc:1261] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Refusing update from remote peer 1106deee2d9b4d30a9aaac7eaa5e3f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:09.459124 15209 raft_consensus.cc:1261] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Refusing update from remote peer 1106deee2d9b4d30a9aaac7eaa5e3f6d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:09.459369 15566 consensus_queue.cc:1035] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:09.460361 15566 consensus_queue.cc:1035] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:09.477171 15565 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: TxnStatusTablet state changed. Reason: New leader 1106deee2d9b4d30a9aaac7eaa5e3f6d. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.477754 15565 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.481050 15584 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: TxnStatusTablet state changed. Reason: New leader 1106deee2d9b4d30a9aaac7eaa5e3f6d. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.481472 15584 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.484174 15652 mvcc.cc:205] Tried to move back new op lower bound from 7315997038411542528 to 7315997038134722560. Current Snapshot: MvccSnapshot[applied={T|T < 7315997038411542528}]
I20260807 19:48:09.494282 15565 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.494686 15565 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P f5e9ee4227a54d4d81f6cb230100fe06: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.506486 15640 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.506991 15640 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:48:09.513005 15640 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.513532 15640 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 1106deee2d9b4d30a9aaac7eaa5e3f6d: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:48:09.518455 15584 tablet_replica.cc:439] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 } } peers { permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 } } peers { permanent_uuid: "f5e9ee4227a54d4d81f6cb230100fe06" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43059 } } }
I20260807 19:48:09.518812 15584 tablet_replica.cc:442] T e163137989134e2e8268d428e90bff2e P 3c525670e3cf4b53bc3e0f85f7f04c46: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:09.534173 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.527047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41726 (local address 127.12.155.131:43059)
0807 19:48:09.527264 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.527269 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.527856 (+ 587us) server_negotiation.cc:407] Connection header received
0807 19:48:09.528187 (+ 331us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.528192 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.528314 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.528513 (+ 199us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:09.529080 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.529882 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.531400 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.531886 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.532032 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.532592 (+ 560us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.533451 (+ 859us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.533634 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.533689 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.533791 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 19:48:09.554941 15673 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.547870 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45197 (local address 127.12.155.131:45385)
0807 19:48:09.548552 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.548570 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.548728 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.549142 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.549145 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.549156 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:09.549516 (+ 360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.549526 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.551120 (+ 1594us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.551124 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.552269 (+ 1145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.552282 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.553450 (+ 1168us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.553455 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.553592 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.553661 (+ 69us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.554253 (+ 592us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.554267 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.554365 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.554510 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":546,"threads_started":1}
I20260807 19:48:09.554912 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.548112 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:45385 (local address 127.12.155.129:45197)
0807 19:48:09.548399 (+ 287us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.548409 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.548654 (+ 245us) server_negotiation.cc:407] Connection header received
0807 19:48:09.548893 (+ 239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.548899 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.549010 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.549119 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:09.549692 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.550979 (+ 1287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.552424 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.553239 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.553397 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.553849 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.554049 (+ 200us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.554176 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.554418 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.554523 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:48:09.568197 15209 raft_consensus.cc:1261] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Refusing update from remote peer f5e9ee4227a54d4d81f6cb230100fe06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:09.568812 14951 raft_consensus.cc:1261] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Refusing update from remote peer f5e9ee4227a54d4d81f6cb230100fe06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:09.569065 15565 consensus_queue.cc:1035] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3c525670e3cf4b53bc3e0f85f7f04c46" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 41675 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:09.569543 15614 consensus_queue.cc:1035] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1106deee2d9b4d30a9aaac7eaa5e3f6d" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45197 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:09.634045 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.619779 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:54765 (local address 127.12.155.131:43059)
0807 19:48:09.619973 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.619980 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.625789 (+ 5809us) server_negotiation.cc:407] Connection header received
0807 19:48:09.625992 (+ 203us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.625998 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.626153 (+ 155us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.626266 (+ 113us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:09.627290 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.628533 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.631272 (+ 2739us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.632055 (+ 783us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.632202 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.632837 (+ 635us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.633040 (+ 203us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.633142 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.633553 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.633673 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 19:48:09.635118 15684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.619796 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:43059 (local address 127.12.155.129:54765)
0807 19:48:09.625609 (+ 5813us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:09.625633 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:09.625824 (+ 191us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:09.626295 (+ 471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:09.626300 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:09.626315 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:09.626858 (+ 543us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.626871 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.628936 (+ 2065us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.628942 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.631098 (+ 2156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:09.631116 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.632258 (+ 1142us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.632267 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:09.632479 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.632587 (+ 108us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:09.633377 (+ 790us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:09.633393 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 19:48:09.634406 (+ 1013us) client_negotiation.cc:240] Negotiation successful
0807 19:48:09.634590 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5524,"thread_start_us":5342,"threads_started":1}
I20260807 19:48:09.695691 14692 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:09.696183 14692 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58442:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:09.701025 14692 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 48262c3b238d48988a8d362b51263dab: Sending DeleteTablet for 3 replicas of tablet ebfdbb854ce74b2da6a25298cfba6e39
I20260807 19:48:09.702251 15158 tablet_service.cc:1514] Processing DeleteTablet for tablet ebfdbb854ce74b2da6a25298cfba6e39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:09 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:54062
I20260807 19:48:09.702236 14906 tablet_service.cc:1514] Processing DeleteTablet for tablet ebfdbb854ce74b2da6a25298cfba6e39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:09 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:49914
I20260807 19:48:09.703807 15397 tablet_service.cc:1514] Processing DeleteTablet for tablet ebfdbb854ce74b2da6a25298cfba6e39 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:09 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:41714
I20260807 19:48:09.712800 15692 tablet_replica.cc:330] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: stopping tablet replica
I20260807 19:48:09.713325 15692 raft_consensus.cc:2229] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:09.713838 15692 raft_consensus.cc:2258] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:09.715090 15693 tablet_replica.cc:330] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: stopping tablet replica
I20260807 19:48:09.722090 15693 raft_consensus.cc:2229] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:09.723773 15693 raft_consensus.cc:2258] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:09.724176 15694 tablet_replica.cc:330] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: stopping tablet replica
I20260807 19:48:09.724499 15694 raft_consensus.cc:2229] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:09.724545 15692 ts_tablet_manager.cc:1905] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:09.725432 15694 raft_consensus.cc:2258] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:09.727026 15694 ts_tablet_manager.cc:1905] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:09.727010 15693 ts_tablet_manager.cc:1905] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:09.737075 15694 ts_tablet_manager.cc:1918] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:09.737336 15694 log.cc:1196] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/ebfdbb854ce74b2da6a25298cfba6e39
I20260807 19:48:09.737958 15694 ts_tablet_manager.cc:1939] T ebfdbb854ce74b2da6a25298cfba6e39 P f5e9ee4227a54d4d81f6cb230100fe06: Deleting consensus metadata
I20260807 19:48:09.739699 14669 catalog_manager.cc:4841] TS f5e9ee4227a54d4d81f6cb230100fe06 (127.12.155.131:43059): tablet ebfdbb854ce74b2da6a25298cfba6e39 (table test-table [id=48529cac24784a28a1e3bf055041f493]) successfully deleted
I20260807 19:48:09.747057 15692 ts_tablet_manager.cc:1918] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:09.747402 15692 log.cc:1196] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/ebfdbb854ce74b2da6a25298cfba6e39
I20260807 19:48:09.748104 15692 ts_tablet_manager.cc:1939] T ebfdbb854ce74b2da6a25298cfba6e39 P 1106deee2d9b4d30a9aaac7eaa5e3f6d: Deleting consensus metadata
I20260807 19:48:09.749593 15693 ts_tablet_manager.cc:1918] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:09.749774 15693 log.cc:1196] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SmokeTestAsAuthorizedUser.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/ebfdbb854ce74b2da6a25298cfba6e39
I20260807 19:48:09.749677 14670 catalog_manager.cc:4841] TS 1106deee2d9b4d30a9aaac7eaa5e3f6d (127.12.155.129:45197): tablet ebfdbb854ce74b2da6a25298cfba6e39 (table test-table [id=48529cac24784a28a1e3bf055041f493]) successfully deleted
I20260807 19:48:09.750366 15693 ts_tablet_manager.cc:1939] T ebfdbb854ce74b2da6a25298cfba6e39 P 3c525670e3cf4b53bc3e0f85f7f04c46: Deleting consensus metadata
I20260807 19:48:09.751686 14672 catalog_manager.cc:4841] TS 3c525670e3cf4b53bc3e0f85f7f04c46 (127.12.155.130:41675): tablet ebfdbb854ce74b2da6a25298cfba6e39 (table test-table [id=48529cac24784a28a1e3bf055041f493]) successfully deleted
Aug 07 19:48:09 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:09.769793 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.738296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49928 (local address 127.12.155.129:45197)
0807 19:48:09.738656 (+ 360us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.738664 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.747053 (+ 8389us) server_negotiation.cc:407] Connection header received
0807 19:48:09.751820 (+ 4767us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.751829 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.751942 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.752050 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:09.754108 (+ 2058us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.755068 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.756478 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.756965 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.757163 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.761922 (+ 4759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:09.761937 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:09.761958 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:09.762012 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:09.766339 (+ 4327us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.767214 (+ 875us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.767227 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.767231 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.767404 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.767830 (+ 426us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.767835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.767838 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.768308 (+ 470us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:09.768699 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.769020 (+ 321us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.769318 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
W20260807 19:48:09.770772 15025 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.SetFlag from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49928
I20260807 19:48:09.804020 15702 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.775169 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58458 (local address 127.12.155.190:44737)
0807 19:48:09.787710 (+ 12541us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.787721 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.788563 (+ 842us) server_negotiation.cc:407] Connection header received
0807 19:48:09.788851 (+ 288us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.788858 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.788959 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.789107 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:09.790889 (+ 1782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.791825 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.793149 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.793633 (+ 484us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.793802 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.797019 (+ 3217us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:09.797024 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:09.797028 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:09.797070 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:09.800697 (+ 3627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.801460 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.801466 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.801468 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.801627 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.802110 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.802119 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.802125 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.802474 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:09.802788 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.803146 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.803428 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12281,"thread_start_us":12509,"threads_started":1}
W20260807 19:48:09.805035 14692 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:58458
I20260807 19:48:09.808403 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14802
I20260807 19:48:09.830214 15547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.809930 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49932 (local address 127.12.155.129:45197)
0807 19:48:09.810199 (+ 269us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.810209 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.814746 (+ 4537us) server_negotiation.cc:407] Connection header received
0807 19:48:09.815008 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.815013 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.815100 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.815232 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:09.816648 (+ 1416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.817510 (+ 862us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.818917 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.819496 (+ 579us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.819659 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.822818 (+ 3159us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:09.822831 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:09.822839 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:09.822888 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:09.826523 (+ 3635us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.827387 (+ 864us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.827392 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.827394 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.827559 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.828214 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.828224 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.828226 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.828619 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:09.828947 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.829389 (+ 442us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.829676 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
W20260807 19:48:09.831060 15025 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:49932
W20260807 19:48:09.831835 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14802: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:09.832113 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14802
I20260807 19:48:09.889034 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15040
Aug 07 19:48:09 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:09.912060 15706 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.890166 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54080 (local address 127.12.155.130:41675)
0807 19:48:09.890829 (+ 663us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.890834 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.890855 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:48:09.890929 (+ 74us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.890933 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.891010 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.891117 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:09.893145 (+ 2028us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.894040 (+ 895us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.896258 (+ 2218us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.896831 (+ 573us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.897033 (+ 202us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.903555 (+ 6522us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:09.903585 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:09.903616 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:09.903714 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:09.907915 (+ 4201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.909072 (+ 1157us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.909083 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.909085 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.909255 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.909859 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.909865 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.909868 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.910495 (+ 627us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:09.910864 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.911260 (+ 396us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.911504 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":375,"threads_started":1}
W20260807 19:48:09.913180 15284 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54080
W20260807 19:48:09.914227 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15040: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:09.914484 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15040
I20260807 19:48:09.961102 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15300
Aug 07 19:48:09 dist-test-slave-2p8l krb5kdc[14624](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132088, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:09.984160 15639 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:09.962211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41736 (local address 127.12.155.131:43059)
0807 19:48:09.962471 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:09.962476 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:09.962677 (+ 201us) server_negotiation.cc:407] Connection header received
0807 19:48:09.962784 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:09.962789 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:09.962881 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:09.963010 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:09.965089 (+ 2079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.965970 (+ 881us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.968329 (+ 2359us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:09.968831 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:09.968957 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:09.975946 (+ 6989us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:09.975973 (+ 27us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:09.976000 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:09.976061 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:09.980186 (+ 4125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.981220 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.981231 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.981234 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.981432 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:09.981937 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:09.981943 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:09.981949 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:09.982621 (+ 672us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:09.983057 (+ 436us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:09.983429 (+ 372us) server_negotiation.cc:299] Negotiation successful
0807 19:48:09.983732 (+ 303us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":109}
W20260807 19:48:09.985226 15513 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:41736
W20260807 19:48:09.986212 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15300: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:09.986447 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15300
I20260807 19:48:10.025216 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14641
I20260807 19:48:10.026991 14755 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:10.177222 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14641
2026-08-07T19:48:10Z chronyd exiting
[ OK ] SecurityITest.SmokeTestAsAuthorizedUser (6200 ms)
[ RUN ] SecurityITest.TxnSmokeWithDifferentUserTypes
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:10 dist-test-slave-2p8l krb5kdc[15712](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:10 dist-test-slave-2p8l krb5kdc[15712](info): set up 2 sockets
Aug 07 19:48:10 dist-test-slave-2p8l krb5kdc[15712](info): commencing operation
krb5kdc: starting...
W20260807 19:48:11.615593 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.375s user 0.005s sys 0.022s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:11 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:11Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:11Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:11.882477 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42733
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:42733
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:12.278872 15735 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:12.279238 15735 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:12.279417 15735 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:12.287220 15735 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:12.287361 15735 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 19:48:12.287406 15735 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:12.287472 15735 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:12.287525 15735 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:12.287593 15735 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:12.299083 15735 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:42733
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42733
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:12.300799 15735 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:12.302541 15735 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:12.316990 15743 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:12.316932 15749 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:12.316955 15745 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:12.317999 15735 server_base.cc:1034] running on GCE node
I20260807 19:48:12.318990 15735 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:12.320739 15735 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:12.322008 15735 hybrid_clock.cc:648] HybridClock initialized: now 1786132092321954 us; error 49 us; skew 500 ppm
I20260807 19:48:12.322424 15735 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:12 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132092, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:12.326349 15735 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:12.328122 15735 webserver.cc:460] Webserver started at http://127.12.155.190:36959/ using document root <none> and password file <none>
I20260807 19:48:12.329021 15735 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:12.329183 15735 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:12.329599 15735 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:12.333186 15735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "9bab00c11fb24610b13edb69166d33c1"
format_stamp: "Formatted at 2026-08-07 19:48:12 on dist-test-slave-2p8l"
server_key: "296589598eac461e9199a1d342980ab3"
server_key_iv: "dee823bcecd0746b96076330bb2c4389"
server_key_version: "encryptionkey@0"
I20260807 19:48:12.334128 15735 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "9bab00c11fb24610b13edb69166d33c1"
format_stamp: "Formatted at 2026-08-07 19:48:12 on dist-test-slave-2p8l"
server_key: "296589598eac461e9199a1d342980ab3"
server_key_iv: "dee823bcecd0746b96076330bb2c4389"
server_key_version: "encryptionkey@0"
I20260807 19:48:12.340358 15735 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 19:48:12.345077 15758 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:12.346781 15735 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:48:12.346997 15735 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "9bab00c11fb24610b13edb69166d33c1"
format_stamp: "Formatted at 2026-08-07 19:48:12 on dist-test-slave-2p8l"
server_key: "296589598eac461e9199a1d342980ab3"
server_key_iv: "dee823bcecd0746b96076330bb2c4389"
server_key_version: "encryptionkey@0"
I20260807 19:48:12.347250 15735 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:12.375015 15735 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:12.380740 15735 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:12.381117 15735 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:12.406723 15735 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:42733
I20260807 19:48:12.406745 15860 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:42733 every 8 connection(s)
I20260807 19:48:12.408473 15735 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:12.411796 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15735
I20260807 19:48:12.412052 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:12.412825 12910 external_mini_cluster.cc:1428] Setting key 034fa373a4866c34bbb38bf968b22099
I20260807 19:48:12.413683 15862 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:48:12 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132091, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:12.431993 15862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Bootstrap starting.
I20260807 19:48:12.436383 15862 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:12.437728 15862 log.cc:824] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:12.441169 15867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:12.415436 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41704 (local address 127.12.155.190:42733)
0807 19:48:12.416490 (+ 1054us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:12.416510 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:12.416581 (+ 71us) server_negotiation.cc:407] Connection header received
0807 19:48:12.418742 (+ 2161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:12.418785 (+ 43us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:12.419541 (+ 756us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:12.420179 (+ 638us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:12.422006 (+ 1827us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:12.424547 (+ 2541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:12.426017 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:12.427271 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:12.427539 (+ 268us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:12.432410 (+ 4871us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:12.432421 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:12.432443 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:12.432493 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:12.436007 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:12.436865 (+ 858us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:12.436874 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:12.436881 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:12.437082 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:12.437511 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:12.437517 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:12.437520 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:12.438229 (+ 709us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:12.438567 (+ 338us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:12.439073 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 19:48:12.439616 (+ 543us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":715,"thread_start_us":410,"threads_started":1}
I20260807 19:48:12.441991 15862 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: No bootstrap required, opened a new log
I20260807 19:48:12.450809 15862 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bab00c11fb24610b13edb69166d33c1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42733 } }
I20260807 19:48:12.451254 15862 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:12.451340 15862 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bab00c11fb24610b13edb69166d33c1, State: Initialized, Role: FOLLOWER
I20260807 19:48:12.452203 15862 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bab00c11fb24610b13edb69166d33c1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42733 } }
I20260807 19:48:12.452507 15862 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:12.452684 15862 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:12.452881 15862 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:12.455503 15862 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bab00c11fb24610b13edb69166d33c1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42733 } }
I20260807 19:48:12.456064 15862 leader_election.cc:302] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9bab00c11fb24610b13edb69166d33c1; no voters:
I20260807 19:48:12.456693 15862 leader_election.cc:288] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:12.456885 15870 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:12.457697 15870 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [term 1 LEADER]: Becoming Leader. State: Replica: 9bab00c11fb24610b13edb69166d33c1, State: Running, Role: LEADER
I20260807 19:48:12.458511 15870 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bab00c11fb24610b13edb69166d33c1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42733 } }
I20260807 19:48:12.459275 15862 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:12.462054 15874 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9bab00c11fb24610b13edb69166d33c1. Latest consensus state: current_term: 1 leader_uuid: "9bab00c11fb24610b13edb69166d33c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bab00c11fb24610b13edb69166d33c1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42733 } } }
I20260807 19:48:12.462365 15871 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9bab00c11fb24610b13edb69166d33c1" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9bab00c11fb24610b13edb69166d33c1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42733 } } }
I20260807 19:48:12.462656 15874 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:12.462766 15871 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:12.465289 15881 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:12.472898 15881 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:12.483767 15881 catalog_manager.cc:1347] Generated new cluster ID: 676441092993420c8769bedb917bd7d1
I20260807 19:48:12.483923 15881 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:12.523880 15881 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:12.525509 15881 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:12.536674 15881 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Generated new TSK 0
I20260807 19:48:12.537772 15881 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:12.598052 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42733
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:13.017460 15905 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:13.017861 15905 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:13.017983 15905 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:13.026139 15905 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:13.026300 15905 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:13.026404 15905 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 19:48:13.026463 15905 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:48:13.026537 15905 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:13.038149 15905 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:42733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:13.039945 15905 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:13.041690 15905 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:13.059835 15915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:13.059871 15914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:13.059844 15918 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:13.061007 15905 server_base.cc:1034] running on GCE node
I20260807 19:48:13.061782 15905 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:13.065675 15905 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:13.067082 15905 hybrid_clock.cc:648] HybridClock initialized: now 1786132093066984 us; error 93 us; skew 500 ppm
I20260807 19:48:13.067516 15905 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:13 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:13.071450 15905 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:13.073343 15905 webserver.cc:460] Webserver started at http://127.12.155.129:40377/ using document root <none> and password file <none>
I20260807 19:48:13.074303 15905 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:13.074466 15905 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:13.074870 15905 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:13.078599 15905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "eb4c2a9053e24054969ae596489df911"
format_stamp: "Formatted at 2026-08-07 19:48:13 on dist-test-slave-2p8l"
server_key: "8dfd01e7de91e2a979119e341db3b628"
server_key_iv: "5f4be50e62899cf29fb87036e87cbf1b"
server_key_version: "encryptionkey@0"
I20260807 19:48:13.079514 15905 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "eb4c2a9053e24054969ae596489df911"
format_stamp: "Formatted at 2026-08-07 19:48:13 on dist-test-slave-2p8l"
server_key: "8dfd01e7de91e2a979119e341db3b628"
server_key_iv: "5f4be50e62899cf29fb87036e87cbf1b"
server_key_version: "encryptionkey@0"
I20260807 19:48:13.086249 15905 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260807 19:48:13.090705 15931 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:13.092437 15905 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260807 19:48:13.092665 15905 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "eb4c2a9053e24054969ae596489df911"
format_stamp: "Formatted at 2026-08-07 19:48:13 on dist-test-slave-2p8l"
server_key: "8dfd01e7de91e2a979119e341db3b628"
server_key_iv: "5f4be50e62899cf29fb87036e87cbf1b"
server_key_version: "encryptionkey@0"
I20260807 19:48:13.092938 15905 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:13.114629 15905 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:13.120222 15905 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:13.120597 15905 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:13.124837 15905 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:13.124985 15905 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:13.125124 15905 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:13.125233 15905 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:48:13 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:13.155155 15943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.125642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:57853 (local address 127.12.155.190:42733)
0807 19:48:13.126336 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:13.126341 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:13.127718 (+ 1377us) server_negotiation.cc:407] Connection header received
0807 19:48:13.130377 (+ 2659us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:13.130384 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:13.130508 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:13.130681 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:13.133676 (+ 2995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.135194 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.137917 (+ 2723us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.138790 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.138958 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.145334 (+ 6376us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:13.145345 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:13.145354 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:13.145427 (+ 73us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:13.150110 (+ 4683us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.151260 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.151265 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.151268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.151414 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.152117 (+ 703us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.152121 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.152124 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.152597 (+ 473us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:13.152786 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:13.154211 (+ 1425us) server_negotiation.cc:299] Negotiation successful
0807 19:48:13.154588 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":409,"threads_started":1}
I20260807 19:48:13.156664 15947 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.126489 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.12.155.129:57853)
0807 19:48:13.127517 (+ 1028us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:13.127570 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:13.129985 (+ 2415us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:13.131204 (+ 1219us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:13.131214 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:13.132358 (+ 1144us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:13.133376 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.133430 (+ 54us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.135401 (+ 1971us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.135418 (+ 17us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.137726 (+ 2308us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.137750 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.139435 (+ 1685us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.139445 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.139884 (+ 439us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.140996 (+ 1112us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:13.141039 (+ 43us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:13.145037 (+ 3998us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:13.150307 (+ 5270us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.150322 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.150351 (+ 29us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.151065 (+ 714us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.151554 (+ 489us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.151562 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.151571 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.151971 (+ 400us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.152759 (+ 788us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:13.152769 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:13.153564 (+ 795us) client_negotiation.cc:769] Sending connection context
0807 19:48:13.154024 (+ 460us) client_negotiation.cc:240] Negotiation successful
0807 19:48:13.154929 (+ 905us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":744,"thread_start_us":457,"threads_started":1}
I20260807 19:48:13.183364 15905 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:43753
I20260807 19:48:13.183382 16127 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:43753 every 8 connection(s)
I20260807 19:48:13.183868 15943 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.165624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:48067 (local address 127.12.155.190:42733)
0807 19:48:13.165919 (+ 295us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:13.165927 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:13.167219 (+ 1292us) server_negotiation.cc:407] Connection header received
0807 19:48:13.167492 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:13.167503 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:13.167618 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:13.167779 (+ 161us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:13.169499 (+ 1720us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.170682 (+ 1183us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.172736 (+ 2054us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.173541 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.173697 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.176612 (+ 2915us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:13.176617 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:13.176621 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:13.176659 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:13.180531 (+ 3872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.181325 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.181332 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.181336 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.181502 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.181955 (+ 453us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.181961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.181964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.182504 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:13.182687 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:13.183167 (+ 480us) server_negotiation.cc:299] Negotiation successful
0807 19:48:13.183450 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:48:13.184072 16067 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.166017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.12.155.129:48067)
0807 19:48:13.167072 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:13.167095 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:13.167309 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:13.167820 (+ 511us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:13.167829 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:13.168724 (+ 895us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:13.169322 (+ 598us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.169344 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.170892 (+ 1548us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.170895 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.172580 (+ 1685us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.172594 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.173801 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.173812 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.173987 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.174854 (+ 867us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:13.174917 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:13.176334 (+ 1417us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:13.180714 (+ 4380us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.180719 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.180722 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.181186 (+ 464us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.181630 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.181636 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.181641 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.181794 (+ 153us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.182636 (+ 842us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:13.182641 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:13.182886 (+ 245us) client_negotiation.cc:769] Sending connection context
0807 19:48:13.183055 (+ 169us) client_negotiation.cc:240] Negotiation successful
0807 19:48:13.183481 (+ 426us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":876,"thread_start_us":637,"threads_started":1}
I20260807 19:48:13.185281 15905 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:13.187984 16128 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42733
I20260807 19:48:13.188295 16128 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:13.188989 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15905
I20260807 19:48:13.189254 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:13.189399 16128 heartbeater.cc:511] Master 127.12.155.190:42733 requested a full tablet report, sending...
I20260807 19:48:13.190303 12910 external_mini_cluster.cc:1428] Setting key a7d72bcdf4bbc883533bb41e37999c02
I20260807 19:48:13.192211 15784 ts_manager.cc:194] Registered new tserver with Master: eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753)
I20260807 19:48:13.194453 15784 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:57853
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:13.245959 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42733
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:13.657151 16138 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:13.657590 16138 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:13.657804 16138 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:13.666455 16138 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:13.666654 16138 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:13.666841 16138 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 19:48:13.666944 16138 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:48:13.667099 16138 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:13.678452 16138 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:42733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:13.680356 16138 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:13.682194 16138 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:13.699033 16145 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:13.698904 16146 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:13.698999 16149 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:13.700081 16138 server_base.cc:1034] running on GCE node
I20260807 19:48:13.700850 16138 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:13.702003 16138 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:13.703279 16138 hybrid_clock.cc:648] HybridClock initialized: now 1786132093703234 us; error 49 us; skew 500 ppm
I20260807 19:48:13.703682 16138 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:13 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:13.707458 16138 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:13.709160 16138 webserver.cc:460] Webserver started at http://127.12.155.130:33719/ using document root <none> and password file <none>
I20260807 19:48:13.709993 16138 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:13.710182 16138 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:13.710542 16138 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:13.714330 16138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "58e8c0b046014989a938397d63ee8ff9"
format_stamp: "Formatted at 2026-08-07 19:48:13 on dist-test-slave-2p8l"
server_key: "3bf347ce4a1ef6b103ba670e8eeb2d90"
server_key_iv: "cbe81fc7dcbe08185ece91c41f24285c"
server_key_version: "encryptionkey@0"
I20260807 19:48:13.715201 16138 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "58e8c0b046014989a938397d63ee8ff9"
format_stamp: "Formatted at 2026-08-07 19:48:13 on dist-test-slave-2p8l"
server_key: "3bf347ce4a1ef6b103ba670e8eeb2d90"
server_key_iv: "cbe81fc7dcbe08185ece91c41f24285c"
server_key_version: "encryptionkey@0"
I20260807 19:48:13.721481 16138 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:48:13.725765 16162 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:13.728018 16138 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:13.728264 16138 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "58e8c0b046014989a938397d63ee8ff9"
format_stamp: "Formatted at 2026-08-07 19:48:13 on dist-test-slave-2p8l"
server_key: "3bf347ce4a1ef6b103ba670e8eeb2d90"
server_key_iv: "cbe81fc7dcbe08185ece91c41f24285c"
server_key_version: "encryptionkey@0"
I20260807 19:48:13.728560 16138 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:13.747638 16138 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:13.752846 16138 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:13.753262 16138 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:13.756659 16138 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:13.756795 16138 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:13.756955 16138 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:13.757059 16138 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:48:13 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132093, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:13.784969 16187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.757642 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:57483 (local address 127.12.155.190:42733)
0807 19:48:13.758306 (+ 664us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:13.758314 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:13.759869 (+ 1555us) server_negotiation.cc:407] Connection header received
0807 19:48:13.762429 (+ 2560us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:13.762439 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:13.762582 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:13.762746 (+ 164us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:13.765179 (+ 2433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.766498 (+ 1319us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.769400 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.770241 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.770412 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.776760 (+ 6348us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:13.776772 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:13.776779 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:13.776846 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:13.780766 (+ 3920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.781662 (+ 896us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.781670 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.781674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.781883 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.782661 (+ 778us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.782669 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.782675 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.783050 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:13.783243 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:13.784208 (+ 965us) server_negotiation.cc:299] Negotiation successful
0807 19:48:13.784525 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":507,"thread_start_us":297,"threads_started":1}
I20260807 19:48:13.786621 16188 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.758433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.12.155.130:57483)
0807 19:48:13.759628 (+ 1195us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:13.759686 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:13.761898 (+ 2212us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:13.763124 (+ 1226us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:13.763144 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:13.763991 (+ 847us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:13.764894 (+ 903us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.764945 (+ 51us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.766686 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.766699 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.769216 (+ 2517us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.769230 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.770604 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.770614 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.771015 (+ 401us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.772057 (+ 1042us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:13.772109 (+ 52us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:13.776437 (+ 4328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:13.780956 (+ 4519us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.780968 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.780999 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.781508 (+ 509us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.782048 (+ 540us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.782104 (+ 56us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.782110 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.782452 (+ 342us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.783207 (+ 755us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:13.783218 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:13.783720 (+ 502us) client_negotiation.cc:769] Sending connection context
0807 19:48:13.784056 (+ 336us) client_negotiation.cc:240] Negotiation successful
0807 19:48:13.784775 (+ 719us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":866,"thread_start_us":454,"threads_started":1}
I20260807 19:48:13.812619 16187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.794743 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:43213 (local address 127.12.155.190:42733)
0807 19:48:13.794960 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:13.794964 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:13.795877 (+ 913us) server_negotiation.cc:407] Connection header received
0807 19:48:13.796150 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:13.796159 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:13.796285 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:13.796414 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:13.798407 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.799831 (+ 1424us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.802124 (+ 2293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.802592 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.802745 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.805206 (+ 2461us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:13.805211 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:13.805215 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:13.805255 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:13.808968 (+ 3713us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.809801 (+ 833us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.809808 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.809817 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.809965 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:13.810535 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:13.810544 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:13.810551 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:13.811255 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:13.811491 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:13.811905 (+ 414us) server_negotiation.cc:299] Negotiation successful
0807 19:48:13.812219 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:48:13.813370 16291 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:13.794932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.12.155.130:43213)
0807 19:48:13.795744 (+ 812us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:13.795764 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:13.795989 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:13.796496 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:13.796509 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:13.797465 (+ 956us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:13.798137 (+ 672us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.798160 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.800005 (+ 1845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.800016 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.801916 (+ 1900us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:13.801937 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:13.802824 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:13.802831 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:13.803023 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:13.803912 (+ 889us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:13.803945 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:13.804974 (+ 1029us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:13.809124 (+ 4150us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.809130 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.809135 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.809648 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.810121 (+ 473us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:13.810126 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:13.810131 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:13.810360 (+ 229us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:13.811407 (+ 1047us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:13.811411 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:13.811606 (+ 195us) client_negotiation.cc:769] Sending connection context
0807 19:48:13.811767 (+ 161us) client_negotiation.cc:240] Negotiation successful
0807 19:48:13.812314 (+ 547us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":482,"threads_started":1}
I20260807 19:48:13.821365 16138 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:36531
I20260807 19:48:13.821411 16362 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:36531 every 8 connection(s)
I20260807 19:48:13.822934 16138 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:13.825515 16363 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42733
I20260807 19:48:13.825789 16363 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:13.825845 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16138
I20260807 19:48:13.826120 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:13.826663 12910 external_mini_cluster.cc:1428] Setting key 11d96de46034dc9b29904d24a4c107ba
I20260807 19:48:13.826704 16363 heartbeater.cc:511] Master 127.12.155.190:42733 requested a full tablet report, sending...
I20260807 19:48:13.828315 15783 ts_manager.cc:194] Registered new tserver with Master: 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531)
I20260807 19:48:13.829541 15783 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:57483
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:13.885418 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42733
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35727
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true
--txn_keepalive_interval_ms=500 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:14.197763 16128 heartbeater.cc:503] Master 127.12.155.190:42733 was elected leader, sending a full tablet report...
W20260807 19:48:14.284873 16369 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:14.285331 16369 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:14.285542 16369 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:14.293936 16369 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:14.294137 16369 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:14.294302 16369 flags.cc:425] Enabled experimental flag: --txn_keepalive_interval_ms=500
W20260807 19:48:14.294395 16369 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:48:14.294541 16369 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:14.305884 16369 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35727
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--txn_keepalive_interval_ms=500
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:42733
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:14.307758 16369 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:14.309486 16369 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:14.326104 16377 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:14.325991 16379 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:14.326380 16381 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:14.327198 16369 server_base.cc:1034] running on GCE node
I20260807 19:48:14.327999 16369 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:14.329324 16369 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:14.330610 16369 hybrid_clock.cc:648] HybridClock initialized: now 1786132094330542 us; error 51 us; skew 500 ppm
I20260807 19:48:14.331096 16369 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:14 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132094, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:14.338187 16369 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:14.340214 16369 webserver.cc:460] Webserver started at http://127.12.155.131:43261/ using document root <none> and password file <none>
I20260807 19:48:14.341161 16369 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:14.341324 16369 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:14.341717 16369 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:14.345568 16369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "5c3e2c4f05b74ef7bcd3e722d8758218"
format_stamp: "Formatted at 2026-08-07 19:48:14 on dist-test-slave-2p8l"
server_key: "0974fa335a140a18cd9286a1808c4f5b"
server_key_iv: "5ee90267705ef28e0abb668e1a1547fc"
server_key_version: "encryptionkey@0"
I20260807 19:48:14.346544 16369 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "5c3e2c4f05b74ef7bcd3e722d8758218"
format_stamp: "Formatted at 2026-08-07 19:48:14 on dist-test-slave-2p8l"
server_key: "0974fa335a140a18cd9286a1808c4f5b"
server_key_iv: "5ee90267705ef28e0abb668e1a1547fc"
server_key_version: "encryptionkey@0"
I20260807 19:48:14.353049 16369 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:14.357400 16389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:14.359143 16369 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:14.359360 16369 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "5c3e2c4f05b74ef7bcd3e722d8758218"
format_stamp: "Formatted at 2026-08-07 19:48:14 on dist-test-slave-2p8l"
server_key: "0974fa335a140a18cd9286a1808c4f5b"
server_key_iv: "5ee90267705ef28e0abb668e1a1547fc"
server_key_version: "encryptionkey@0"
I20260807 19:48:14.359627 16369 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:14.376241 16369 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:14.381214 16369 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:14.381508 16369 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:14.384789 16369 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:14.384971 16369 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:14.385123 16369 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:14.385241 16369 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:48:14 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132094, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:14.416652 16415 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.386369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.12.155.131:56713)
0807 19:48:14.387396 (+ 1027us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.387465 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.389990 (+ 2525us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.391176 (+ 1186us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.391190 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.392411 (+ 1221us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:14.393747 (+ 1336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.393787 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.395428 (+ 1641us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.395434 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.398642 (+ 3208us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.398659 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.399664 (+ 1005us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.399679 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.400103 (+ 424us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.401195 (+ 1092us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:14.401239 (+ 44us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:14.405349 (+ 4110us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:14.410352 (+ 5003us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:14.410364 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:14.410391 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:14.411129 (+ 738us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:14.411688 (+ 559us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:14.411693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:14.411697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:14.412017 (+ 320us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:14.412816 (+ 799us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:14.412829 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:14.413592 (+ 763us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.413976 (+ 384us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.414738 (+ 762us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":686,"thread_start_us":419,"threads_started":1}
I20260807 19:48:14.418062 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.385529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:56713 (local address 127.12.155.190:42733)
0807 19:48:14.386339 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.386347 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.387633 (+ 1286us) server_negotiation.cc:407] Connection header received
0807 19:48:14.390444 (+ 2811us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.390452 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.390586 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.390767 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:14.394037 (+ 3270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.395194 (+ 1157us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.398816 (+ 3622us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.399324 (+ 508us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.399507 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.405671 (+ 6164us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:14.405678 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:14.405682 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:14.405726 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:14.410138 (+ 4412us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:14.411336 (+ 1198us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:14.411343 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:14.411350 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:14.411550 (+ 200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:14.412160 (+ 610us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:14.412165 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:14.412169 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:14.412567 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:14.412728 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.417275 (+ 4547us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.417580 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":514,"threads_started":1}
I20260807 19:48:14.456853 16512 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.435967 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.12.155.131:50045)
0807 19:48:14.436909 (+ 942us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.436933 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.437138 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.437702 (+ 564us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.437708 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.438584 (+ 876us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:14.438919 (+ 335us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.438932 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.440744 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.440753 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.443280 (+ 2527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.443301 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.444540 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.444550 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.444841 (+ 291us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.445809 (+ 968us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:14.445842 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:14.447498 (+ 1656us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:14.453015 (+ 5517us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:14.453024 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:14.453031 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:14.453860 (+ 829us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:14.454423 (+ 563us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:14.454428 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:14.454432 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:14.454594 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:14.455331 (+ 737us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:14.455336 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:14.455592 (+ 256us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.455757 (+ 165us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.456243 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":761,"thread_start_us":573,"threads_started":1}
I20260807 19:48:14.457855 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.435361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:50045 (local address 127.12.155.190:42733)
0807 19:48:14.435650 (+ 289us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.435656 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.437068 (+ 1412us) server_negotiation.cc:407] Connection header received
0807 19:48:14.437325 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.437335 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.437486 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.437641 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:14.439121 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.440507 (+ 1386us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.443466 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.444263 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.444434 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.447828 (+ 3394us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:14.447840 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:14.447849 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:14.447914 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:14.452810 (+ 4896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:14.454080 (+ 1270us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:14.454089 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:14.454095 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:14.454279 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:14.454729 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:14.454734 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:14.454737 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:14.455218 (+ 481us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:14.455392 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.457018 (+ 1626us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.457307 (+ 289us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 19:48:14.476682 16369 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:46303
I20260807 19:48:14.476701 16602 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:46303 every 8 connection(s)
I20260807 19:48:14.479039 16369 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:14.482715 16603 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42733
I20260807 19:48:14.483035 16603 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:14.484163 16603 heartbeater.cc:511] Master 127.12.155.190:42733 requested a full tablet report, sending...
I20260807 19:48:14.486053 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16369
I20260807 19:48:14.486264 15783 ts_manager.cc:194] Registered new tserver with Master: 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303)
I20260807 19:48:14.486348 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:14.487110 12910 external_mini_cluster.cc:1428] Setting key 235ed019703e2032e7b8ac8baaa66571
I20260807 19:48:14.487396 15783 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:56713
I20260807 19:48:14.491343 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:48:14 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:48:14 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132094, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:14.556305 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.540460 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41706 (local address 127.12.155.190:42733)
0807 19:48:14.540762 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.540771 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.540963 (+ 192us) server_negotiation.cc:407] Connection header received
0807 19:48:14.541088 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.541093 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.541174 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.541280 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:14.542968 (+ 1688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.543753 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.544994 (+ 1241us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.545419 (+ 425us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.545517 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.549789 (+ 4272us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:14.549795 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:14.549799 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:14.549844 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:14.553179 (+ 3335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:14.554025 (+ 846us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:14.554030 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:14.554032 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:14.554258 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:14.554635 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:14.554639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:14.554641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:14.554963 (+ 322us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:14.555184 (+ 221us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.555524 (+ 340us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.555741 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 19:48:14.561905 15783 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:14.578966 15783 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:14.626024 16627 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.600443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:46303 (local address 127.0.0.1:58670)
0807 19:48:14.615133 (+ 14690us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.615166 (+ 33us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.615328 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.616522 (+ 1194us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.616530 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.616564 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:14.617185 (+ 621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.617205 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.619854 (+ 2649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.619860 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.622388 (+ 2528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.622405 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.624988 (+ 2583us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.624995 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.625185 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.625223 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.625312 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.625476 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8209,"mutex_wait_us":192,"thread_start_us":19911,"threads_started":1}
I20260807 19:48:14.626183 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.597753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59362 (local address 127.12.155.130:36531)
0807 19:48:14.601071 (+ 3318us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.601084 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.606716 (+ 5632us) server_negotiation.cc:407] Connection header received
0807 19:48:14.606884 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.606897 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.607355 (+ 458us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.607625 (+ 270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:14.610251 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.612557 (+ 2306us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.621441 (+ 8884us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.623555 (+ 2114us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.623812 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.625297 (+ 1485us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.625413 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.625688 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3066,"thread_start_us":3350,"threads_started":1}
I20260807 19:48:14.627297 16625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.600922 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58670 (local address 127.12.155.131:46303)
0807 19:48:14.615731 (+ 14809us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.615738 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.615776 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:48:14.615891 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.615899 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.616249 (+ 350us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.616533 (+ 284us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:14.617467 (+ 934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.619642 (+ 2175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.622601 (+ 2959us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.624262 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.624476 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.624745 (+ 269us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.626699 (+ 1954us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.626900 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14622,"thread_start_us":14348,"threads_started":1}
I20260807 19:48:14.627177 16620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.597621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:36531 (local address 127.0.0.1:59362)
0807 19:48:14.604181 (+ 6560us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.604251 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.604529 (+ 278us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.607976 (+ 3447us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.607990 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.608036 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:14.608724 (+ 688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.608757 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.615292 (+ 6535us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.615300 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.621217 (+ 5917us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.621235 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.624162 (+ 2927us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.624172 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.624527 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.624692 (+ 165us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.624876 (+ 184us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.626600 (+ 1724us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6194,"mutex_wait_us":285,"thread_start_us":2746,"threads_started":1}
I20260807 19:48:14.628139 16624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.603216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43753 (local address 127.0.0.1:42004)
0807 19:48:14.615979 (+ 12763us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.616001 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.616154 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.616995 (+ 841us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.617001 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.617030 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:14.617618 (+ 588us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.617636 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.620023 (+ 2387us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.620031 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.623916 (+ 3885us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.623936 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.627294 (+ 3358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.627301 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.627506 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.627536 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.627639 (+ 103us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.627779 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12585,"thread_start_us":5203,"threads_started":1}
I20260807 19:48:14.628461 16626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.601873 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42004 (local address 127.12.155.129:43753)
0807 19:48:14.614769 (+ 12896us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.614786 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.616151 (+ 1365us) server_negotiation.cc:407] Connection header received
0807 19:48:14.616337 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.616347 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.616601 (+ 254us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.616856 (+ 255us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:14.617899 (+ 1043us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.619792 (+ 1893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.624147 (+ 4355us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.626518 (+ 2371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.626712 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.626882 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.627753 (+ 871us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.627999 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12617,"thread_start_us":12369,"threads_started":1}
I20260807 19:48:14.633229 16486 tablet_service.cc:1467] Processing CreateTablet for tablet 0da453c0a9134a9089ecf77c6002f6e7 (DEFAULT_TABLE table=test-table [id=a6d3bdca220c4e0587356b49b6f5bce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:14.633291 16259 tablet_service.cc:1467] Processing CreateTablet for tablet 0da453c0a9134a9089ecf77c6002f6e7 (DEFAULT_TABLE table=test-table [id=a6d3bdca220c4e0587356b49b6f5bce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:14.635371 16486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0da453c0a9134a9089ecf77c6002f6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:14.635390 16259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0da453c0a9134a9089ecf77c6002f6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:14.639634 16020 tablet_service.cc:1467] Processing CreateTablet for tablet 0da453c0a9134a9089ecf77c6002f6e7 (DEFAULT_TABLE table=test-table [id=a6d3bdca220c4e0587356b49b6f5bce1]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:14.641620 16020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 0da453c0a9134a9089ecf77c6002f6e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:14.658394 16628 tablet_bootstrap.cc:492] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Bootstrap starting.
I20260807 19:48:14.667299 16628 tablet_bootstrap.cc:654] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:14.669651 16628 log.cc:824] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:14.669934 16629 tablet_bootstrap.cc:492] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Bootstrap starting.
I20260807 19:48:14.671825 16633 tablet_bootstrap.cc:492] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Bootstrap starting.
I20260807 19:48:14.677750 16629 tablet_bootstrap.cc:654] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:14.679862 16629 log.cc:824] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:14.680186 16633 tablet_bootstrap.cc:654] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:14.680460 16628 tablet_bootstrap.cc:492] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: No bootstrap required, opened a new log
I20260807 19:48:14.680892 16628 ts_tablet_manager.cc:1397] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent bootstrapping tablet: real 0.023s user 0.012s sys 0.006s
I20260807 19:48:14.681753 16633 log.cc:824] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:14.691434 16629 tablet_bootstrap.cc:492] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: No bootstrap required, opened a new log
I20260807 19:48:14.692129 16629 ts_tablet_manager.cc:1397] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.009s
I20260807 19:48:14.699365 16628 raft_consensus.cc:348] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.700168 16628 raft_consensus.cc:374] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:14.700368 16628 raft_consensus.cc:729] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Initialized, Role: FOLLOWER
I20260807 19:48:14.701407 16628 consensus_queue.cc:260] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.701881 16633 tablet_bootstrap.cc:492] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: No bootstrap required, opened a new log
I20260807 19:48:14.702440 16633 ts_tablet_manager.cc:1397] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Time spent bootstrapping tablet: real 0.031s user 0.017s sys 0.007s
I20260807 19:48:14.707660 16629 raft_consensus.cc:348] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.708468 16629 raft_consensus.cc:374] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:14.708657 16629 raft_consensus.cc:729] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4c2a9053e24054969ae596489df911, State: Initialized, Role: FOLLOWER
I20260807 19:48:14.709686 16629 consensus_queue.cc:260] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.710281 16628 ts_tablet_manager.cc:1428] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent starting tablet: real 0.029s user 0.021s sys 0.004s
I20260807 19:48:14.710865 16603 heartbeater.cc:503] Master 127.12.155.190:42733 was elected leader, sending a full tablet report...
I20260807 19:48:14.720276 16629 ts_tablet_manager.cc:1428] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Time spent starting tablet: real 0.028s user 0.022s sys 0.003s
I20260807 19:48:14.720762 16633 raft_consensus.cc:348] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.721364 16633 raft_consensus.cc:374] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:14.721500 16633 raft_consensus.cc:729] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e8c0b046014989a938397d63ee8ff9, State: Initialized, Role: FOLLOWER
I20260807 19:48:14.722373 16633 consensus_queue.cc:260] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.723680 16363 heartbeater.cc:503] Master 127.12.155.190:42733 was elected leader, sending a full tablet report...
I20260807 19:48:14.724594 16633 ts_tablet_manager.cc:1428] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Time spent starting tablet: real 0.022s user 0.010s sys 0.005s
W20260807 19:48:14.731464 16604 tablet.cc:2369] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:48:14.825488 16364 tablet.cc:2369] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:14.932714 16642 raft_consensus.cc:482] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:14.933156 16642 raft_consensus.cc:504] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.935421 16642 leader_election.cc:288] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531), eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753)
W20260807 19:48:14.938603 16130 tablet.cc:2369] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:14.944093 16621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.936197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:57865 (local address 127.12.155.130:36531)
0807 19:48:14.936442 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.936447 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.937020 (+ 573us) server_negotiation.cc:407] Connection header received
0807 19:48:14.937348 (+ 328us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.937355 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.937457 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.937596 (+ 139us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:14.938287 (+ 691us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.939437 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.941922 (+ 2485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.943102 (+ 1180us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.943293 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.943405 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.943583 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.943732 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:48:14.944114 16649 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.936090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:36531 (local address 127.12.155.131:57865)
0807 19:48:14.936844 (+ 754us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.936896 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.937079 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.937623 (+ 544us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.937628 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.937659 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:14.938116 (+ 457us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.938135 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.939575 (+ 1440us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.939581 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.941758 (+ 2177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.941773 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.943285 (+ 1512us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.943289 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.943408 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.943445 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.943522 (+ 77us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.943629 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":589,"mutex_wait_us":4,"thread_start_us":446,"threads_started":1}
I20260807 19:48:14.944725 16626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.937299 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:49713 (local address 127.12.155.129:43753)
0807 19:48:14.937573 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:14.937580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:14.937867 (+ 287us) server_negotiation.cc:407] Connection header received
0807 19:48:14.938121 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:14.938125 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:14.938191 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:14.938301 (+ 110us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:14.939018 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.940048 (+ 1030us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.942411 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.943693 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.943896 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.943981 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:14.944355 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 19:48:14.944512 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:48:14.945329 16652 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:14.937082 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43753 (local address 127.12.155.131:49713)
0807 19:48:14.937743 (+ 661us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:14.937772 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:14.937945 (+ 173us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:14.938323 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:14.938327 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:14.938358 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:14.938824 (+ 466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.938835 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.940184 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.940189 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.942261 (+ 2072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:14.942272 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:14.943937 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:14.943948 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:14.944144 (+ 196us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:14.944184 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:48:14.944942 (+ 758us) client_negotiation.cc:240] Negotiation successful
0807 19:48:14.945052 (+ 110us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"mutex_wait_us":29,"thread_start_us":488,"threads_started":1}
I20260807 19:48:14.945485 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da453c0a9134a9089ecf77c6002f6e7" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9" is_pre_election: true
I20260807 19:48:14.946224 16297 raft_consensus.cc:2454] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 0.
I20260807 19:48:14.946378 16046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da453c0a9134a9089ecf77c6002f6e7" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4c2a9053e24054969ae596489df911" is_pre_election: true
I20260807 19:48:14.947008 16046 raft_consensus.cc:2454] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 0.
I20260807 19:48:14.947081 16399 leader_election.cc:302] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e8c0b046014989a938397d63ee8ff9, 5c3e2c4f05b74ef7bcd3e722d8758218; no voters:
I20260807 19:48:14.947608 16642 raft_consensus.cc:2781] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:14.947767 16642 raft_consensus.cc:482] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:14.947901 16642 raft_consensus.cc:3037] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:14.950596 16642 raft_consensus.cc:504] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.951364 16642 leader_election.cc:288] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 election: Requested vote from peers 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531), eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753)
I20260807 19:48:14.951882 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da453c0a9134a9089ecf77c6002f6e7" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9"
I20260807 19:48:14.951956 16046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0da453c0a9134a9089ecf77c6002f6e7" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4c2a9053e24054969ae596489df911"
I20260807 19:48:14.952140 16297 raft_consensus.cc:3037] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:14.952250 16046 raft_consensus.cc:3037] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:14.955049 16046 raft_consensus.cc:2454] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 1.
I20260807 19:48:14.955058 16297 raft_consensus.cc:2454] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 1.
I20260807 19:48:14.955566 16399 leader_election.cc:302] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e8c0b046014989a938397d63ee8ff9, 5c3e2c4f05b74ef7bcd3e722d8758218; no voters:
I20260807 19:48:14.955951 16642 raft_consensus.cc:2781] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:14.956485 16642 raft_consensus.cc:686] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 LEADER]: Becoming Leader. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Running, Role: LEADER
I20260807 19:48:14.957180 16642 consensus_queue.cc:237] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:14.963263 15783 catalog_manager.cc:5495] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } health_report { overall_health: HEALTHY } } }
Aug 07 19:48:15 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132092, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:15.045279 16414 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.029452 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41708 (local address 127.12.155.190:42733)
0807 19:48:15.029674 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.029678 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.030353 (+ 675us) server_negotiation.cc:407] Connection header received
0807 19:48:15.030647 (+ 294us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.030652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.030723 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.030819 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:15.032236 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.033162 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.034572 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.034992 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.035091 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.039230 (+ 4139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:15.039237 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:15.039240 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:15.039275 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:15.042471 (+ 3196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:15.043356 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:15.043359 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:15.043362 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:15.043482 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:15.043883 (+ 401us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:15.043887 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:15.043889 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:15.044180 (+ 291us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:15.044297 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.044740 (+ 443us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.045000 (+ 260us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":52,"server-negotiator.queue_time_us":71}
I20260807 19:48:15.045287 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.029461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42733 (local address 127.0.0.1:41708)
0807 19:48:15.030232 (+ 771us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.030251 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.030454 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.030868 (+ 414us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.030872 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.031738 (+ 866us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:15.032097 (+ 359us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.032109 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.033295 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.033300 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.034440 (+ 1140us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.034452 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.035172 (+ 720us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.035177 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.035301 (+ 124us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.036162 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:15.036218 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:15.039044 (+ 2826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:15.042646 (+ 3602us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:15.042659 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:15.042667 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:15.043229 (+ 562us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:15.043601 (+ 372us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:15.043605 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:15.043608 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:15.043764 (+ 156us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:15.044294 (+ 530us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:15.044302 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:15.044477 (+ 175us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.044621 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.044856 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":397,"threads_started":1}
I20260807 19:48:15.051810 15783 catalog_manager.cc:1908] Servicing CreateTable request from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:41708:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 19:48:15.053287 15783 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:15.063982 16020 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec238d7cc19426a8b71e4175dc4a861 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a5a0655cf4e4dc1a327b03784547b35]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:48:15.063987 16259 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec238d7cc19426a8b71e4175dc4a861 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a5a0655cf4e4dc1a327b03784547b35]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:48:15.064224 16486 tablet_service.cc:1467] Processing CreateTablet for tablet 2ec238d7cc19426a8b71e4175dc4a861 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=1a5a0655cf4e4dc1a327b03784547b35]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:48:15.065224 16259 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec238d7cc19426a8b71e4175dc4a861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:15.065230 16020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec238d7cc19426a8b71e4175dc4a861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:15.065234 16486 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2ec238d7cc19426a8b71e4175dc4a861. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:15.071676 16633 tablet_bootstrap.cc:492] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: Bootstrap starting.
I20260807 19:48:15.073235 16628 tablet_bootstrap.cc:492] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: Bootstrap starting.
I20260807 19:48:15.073232 16629 tablet_bootstrap.cc:492] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: Bootstrap starting.
I20260807 19:48:15.073958 16633 tablet_bootstrap.cc:654] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:15.075156 16628 tablet_bootstrap.cc:654] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:15.075150 16629 tablet_bootstrap.cc:654] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:15.078847 16633 tablet_bootstrap.cc:492] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: No bootstrap required, opened a new log
I20260807 19:48:15.079017 16628 tablet_bootstrap.cc:492] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: No bootstrap required, opened a new log
I20260807 19:48:15.079032 16633 ts_tablet_manager.cc:1397] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: Time spent bootstrapping tablet: real 0.007s user 0.004s sys 0.001s
I20260807 19:48:15.079178 16628 ts_tablet_manager.cc:1397] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent bootstrapping tablet: real 0.006s user 0.002s sys 0.003s
I20260807 19:48:15.079993 16628 raft_consensus.cc:348] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.079963 16633 raft_consensus.cc:348] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.080260 16633 raft_consensus.cc:374] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:15.080260 16628 raft_consensus.cc:374] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:15.080364 16628 raft_consensus.cc:729] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Initialized, Role: FOLLOWER
I20260807 19:48:15.080363 16633 raft_consensus.cc:729] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e8c0b046014989a938397d63ee8ff9, State: Initialized, Role: FOLLOWER
I20260807 19:48:15.080662 16628 consensus_queue.cc:260] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.080682 16633 consensus_queue.cc:260] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.081358 16628 ts_tablet_manager.cc:1428] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:48:15.081202 16647 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.081246 16642 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.081646 16647 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.081665 16642 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.084717 16629 tablet_bootstrap.cc:492] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: No bootstrap required, opened a new log
I20260807 19:48:15.084921 16629 ts_tablet_manager.cc:1397] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: Time spent bootstrapping tablet: real 0.012s user 0.005s sys 0.004s
I20260807 19:48:15.085071 16633 ts_tablet_manager.cc:1428] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: Time spent starting tablet: real 0.006s user 0.000s sys 0.002s
I20260807 19:48:15.085757 16629 raft_consensus.cc:348] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.086011 16629 raft_consensus.cc:374] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:15.086174 16629 raft_consensus.cc:729] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4c2a9053e24054969ae596489df911, State: Initialized, Role: FOLLOWER
I20260807 19:48:15.086462 16629 consensus_queue.cc:260] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.087112 16629 ts_tablet_manager.cc:1428] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: Time spent starting tablet: real 0.002s user 0.002s sys 0.000s
I20260807 19:48:15.086975 16646 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.087473 16646 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.203827 16642 raft_consensus.cc:482] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:15.204077 16642 raft_consensus.cc:504] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.204752 16642 leader_election.cc:288] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753), 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531)
I20260807 19:48:15.205436 16046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec238d7cc19426a8b71e4175dc4a861" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4c2a9053e24054969ae596489df911" is_pre_election: true
I20260807 19:48:15.205582 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec238d7cc19426a8b71e4175dc4a861" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9" is_pre_election: true
I20260807 19:48:15.205752 16046 raft_consensus.cc:2454] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 0.
I20260807 19:48:15.205951 16297 raft_consensus.cc:2454] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 0.
I20260807 19:48:15.206390 16399 leader_election.cc:302] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c3e2c4f05b74ef7bcd3e722d8758218, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:15.206674 16642 raft_consensus.cc:2781] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:15.206766 16642 raft_consensus.cc:482] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:15.206918 16642 raft_consensus.cc:3037] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:15.209239 16642 raft_consensus.cc:504] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.209945 16642 leader_election.cc:288] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 election: Requested vote from peers eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753), 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531)
I20260807 19:48:15.210461 16046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec238d7cc19426a8b71e4175dc4a861" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4c2a9053e24054969ae596489df911"
I20260807 19:48:15.210736 16046 raft_consensus.cc:3037] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:15.210625 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2ec238d7cc19426a8b71e4175dc4a861" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9"
I20260807 19:48:15.210999 16297 raft_consensus.cc:3037] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:15.214020 16046 raft_consensus.cc:2454] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 1.
I20260807 19:48:15.214167 16297 raft_consensus.cc:2454] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 1.
I20260807 19:48:15.214515 16399 leader_election.cc:302] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c3e2c4f05b74ef7bcd3e722d8758218, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:15.214844 16642 raft_consensus.cc:2781] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:15.215039 16642 raft_consensus.cc:686] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 LEADER]: Becoming Leader. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Running, Role: LEADER
I20260807 19:48:15.215332 16642 consensus_queue.cc:237] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.217048 16655 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: TxnStatusTablet state changed. Reason: New leader 5c3e2c4f05b74ef7bcd3e722d8758218. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.217376 16655 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:48:15.218132 16679 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 19:48:15.218531 16679 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 19:48:15.219007 15784 catalog_manager.cc:5495] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } health_report { overall_health: HEALTHY } } }
I20260807 19:48:15.246757 16668 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.240078 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:46303 (local address 127.0.0.1:58676)
0807 19:48:15.240352 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.240393 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.240594 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.241302 (+ 708us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.241307 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.241322 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:15.241594 (+ 272us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.241605 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.242890 (+ 1285us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.242899 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.243968 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.243980 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.244781 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.244787 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.244974 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.245039 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.246112 (+ 1073us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.246138 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.246225 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.246410 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":63}
I20260807 19:48:15.246811 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.240198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58676 (local address 127.12.155.131:46303)
0807 19:48:15.240897 (+ 699us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.240901 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.240922 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:48:15.241008 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.241012 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.241098 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.241276 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:15.241757 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.242750 (+ 993us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.244119 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.244606 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.244755 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.245270 (+ 515us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.245959 (+ 689us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.246163 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.246264 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.246356 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":534,"thread_start_us":303,"threads_started":1}
I20260807 19:48:15.257449 16297 raft_consensus.cc:1261] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Refusing update from remote peer 5c3e2c4f05b74ef7bcd3e722d8758218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:15.257504 16046 raft_consensus.cc:1261] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Refusing update from remote peer 5c3e2c4f05b74ef7bcd3e722d8758218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:15.258803 16642 consensus_queue.cc:1035] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:15.259657 16655 consensus_queue.cc:1035] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:15.271822 16647 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: TxnStatusTablet state changed. Reason: New leader 5c3e2c4f05b74ef7bcd3e722d8758218. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.272204 16647 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.275686 16689 mvcc.cc:205] Tried to move back new op lower bound from 7315997062161608704 to 7315997062004080640. Current Snapshot: MvccSnapshot[applied={T|T < 7315997062161608704}]
I20260807 19:48:15.277493 16655 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.277845 16655 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:48:15.282578 16647 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.282843 16647 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 58e8c0b046014989a938397d63ee8ff9: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.287058 16646 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: TxnStatusTablet state changed. Reason: New leader 5c3e2c4f05b74ef7bcd3e722d8758218. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.287415 16646 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.288883 16642 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.289248 16642 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P 5c3e2c4f05b74ef7bcd3e722d8758218: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:48:15.294098 16646 tablet_replica.cc:439] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } } }
I20260807 19:48:15.294413 16646 tablet_replica.cc:442] T 2ec238d7cc19426a8b71e4175dc4a861 P eb4c2a9053e24054969ae596489df911: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:48:15.305541 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.298518 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58686 (local address 127.12.155.131:46303)
0807 19:48:15.298755 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.298762 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.299497 (+ 735us) server_negotiation.cc:407] Connection header received
0807 19:48:15.299658 (+ 161us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.299664 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.299757 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.299850 (+ 93us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:15.300336 (+ 486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.301702 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.303322 (+ 1620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.304100 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.304241 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.304656 (+ 415us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.304818 (+ 162us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.304915 (+ 97us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.305050 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.305147 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 19:48:15.329643 16707 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.321562 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:46303 (local address 127.12.155.131:52963)
0807 19:48:15.322348 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.322367 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.322528 (+ 161us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.322913 (+ 385us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.322916 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.322926 (+ 10us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:15.323347 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.323356 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.325130 (+ 1774us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.325134 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.326628 (+ 1494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.326641 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.327976 (+ 1335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.327980 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.328114 (+ 134us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.328182 (+ 68us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.328727 (+ 545us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.328740 (+ 13us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.328837 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.329007 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":621,"mutex_wait_us":19,"thread_start_us":432,"threads_started":1}
I20260807 19:48:15.329659 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.321481 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:52963 (local address 127.12.155.131:46303)
0807 19:48:15.321672 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.321677 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.322471 (+ 794us) server_negotiation.cc:407] Connection header received
0807 19:48:15.322677 (+ 206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.322684 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.322778 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.322885 (+ 107us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:15.323511 (+ 626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.324962 (+ 1451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.326768 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.327774 (+ 1006us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.327905 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.328454 (+ 549us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.328611 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.328709 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.328884 (+ 175us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.328988 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":54}
I20260807 19:48:15.342113 16297 raft_consensus.cc:1261] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Refusing update from remote peer 5c3e2c4f05b74ef7bcd3e722d8758218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:15.342147 16045 raft_consensus.cc:1261] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Refusing update from remote peer 5c3e2c4f05b74ef7bcd3e722d8758218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:15.342875 16655 consensus_queue.cc:1035] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:15.343271 16642 consensus_queue.cc:1035] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:15.429122 15783 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:15.429535 15783 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:15.434908 15783 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Sending DeleteTablet for 3 replicas of tablet 0da453c0a9134a9089ecf77c6002f6e7
I20260807 19:48:15.436503 16486 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da453c0a9134a9089ecf77c6002f6e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:15 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:58670
I20260807 19:48:15.436470 16259 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da453c0a9134a9089ecf77c6002f6e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:15 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:59362
I20260807 19:48:15.436632 16020 tablet_service.cc:1514] Processing DeleteTablet for tablet 0da453c0a9134a9089ecf77c6002f6e7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:15 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42004
I20260807 19:48:15.439741 15784 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41706:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:15.440598 15784 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:15.446532 16714 tablet_replica.cc:330] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: stopping tablet replica
I20260807 19:48:15.447326 16714 raft_consensus.cc:2229] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:15.448328 16714 raft_consensus.cc:2258] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:15.450369 16718 tablet_replica.cc:330] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: stopping tablet replica
I20260807 19:48:15.451144 16718 raft_consensus.cc:2229] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:15.451718 16716 tablet_replica.cc:330] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: stopping tablet replica
I20260807 19:48:15.452214 16716 raft_consensus.cc:2229] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:15.452204 16020 tablet_service.cc:1467] Processing CreateTablet for tablet 80886c7b0c7442f2829cda7e972fe1f6 (DEFAULT_TABLE table=test-table [id=7c94ed5e774b4d5e9c711886c9b3935a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:15.452437 16257 tablet_service.cc:1467] Processing CreateTablet for tablet 80886c7b0c7442f2829cda7e972fe1f6 (DEFAULT_TABLE table=test-table [id=7c94ed5e774b4d5e9c711886c9b3935a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:15.452682 16716 raft_consensus.cc:2258] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:15.453068 16257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80886c7b0c7442f2829cda7e972fe1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:15.453629 16020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80886c7b0c7442f2829cda7e972fe1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:15.455529 16714 ts_tablet_manager.cc:1905] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:15.459674 16718 raft_consensus.cc:2258] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:15.459847 16485 tablet_service.cc:1467] Processing CreateTablet for tablet 80886c7b0c7442f2829cda7e972fe1f6 (DEFAULT_TABLE table=test-table [id=7c94ed5e774b4d5e9c711886c9b3935a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:15.460549 16485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 80886c7b0c7442f2829cda7e972fe1f6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:15.462280 16718 ts_tablet_manager.cc:1905] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:15.464495 16716 ts_tablet_manager.cc:1905] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:15.466528 16629 tablet_bootstrap.cc:492] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Bootstrap starting.
I20260807 19:48:15.467947 16633 tablet_bootstrap.cc:492] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Bootstrap starting.
I20260807 19:48:15.469003 16629 tablet_bootstrap.cc:654] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:15.470005 16633 tablet_bootstrap.cc:654] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:15.471328 16628 tablet_bootstrap.cc:492] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Bootstrap starting.
I20260807 19:48:15.472640 16718 ts_tablet_manager.cc:1918] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:15.472932 16718 log.cc:1196] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/0da453c0a9134a9089ecf77c6002f6e7
I20260807 19:48:15.473409 16628 tablet_bootstrap.cc:654] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:15.473908 16718 ts_tablet_manager.cc:1939] T 0da453c0a9134a9089ecf77c6002f6e7 P eb4c2a9053e24054969ae596489df911: Deleting consensus metadata
I20260807 19:48:15.477559 16633 tablet_bootstrap.cc:492] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: No bootstrap required, opened a new log
I20260807 19:48:15.477910 16633 ts_tablet_manager.cc:1397] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.004s
I20260807 19:48:15.479104 16633 raft_consensus.cc:348] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.479506 16633 raft_consensus.cc:374] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:15.479625 16633 raft_consensus.cc:729] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e8c0b046014989a938397d63ee8ff9, State: Initialized, Role: FOLLOWER
I20260807 19:48:15.480075 16633 consensus_queue.cc:260] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.481544 16633 ts_tablet_manager.cc:1428] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 19:48:15.482581 15761 catalog_manager.cc:4841] TS eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753): tablet 0da453c0a9134a9089ecf77c6002f6e7 (table test-table [id=a6d3bdca220c4e0587356b49b6f5bce1]) successfully deleted
I20260807 19:48:15.484627 16714 ts_tablet_manager.cc:1918] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:15.484869 16714 log.cc:1196] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/0da453c0a9134a9089ecf77c6002f6e7
I20260807 19:48:15.485615 16714 ts_tablet_manager.cc:1939] T 0da453c0a9134a9089ecf77c6002f6e7 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting consensus metadata
I20260807 19:48:15.486421 16628 tablet_bootstrap.cc:492] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: No bootstrap required, opened a new log
I20260807 19:48:15.486632 16628 ts_tablet_manager.cc:1397] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent bootstrapping tablet: real 0.015s user 0.000s sys 0.007s
I20260807 19:48:15.487795 16628 raft_consensus.cc:348] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.488112 16628 raft_consensus.cc:374] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:15.488245 16628 raft_consensus.cc:729] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Initialized, Role: FOLLOWER
I20260807 19:48:15.488209 15760 catalog_manager.cc:4841] TS 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303): tablet 0da453c0a9134a9089ecf77c6002f6e7 (table test-table [id=a6d3bdca220c4e0587356b49b6f5bce1]) successfully deleted
I20260807 19:48:15.488571 16628 consensus_queue.cc:260] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.489291 16628 ts_tablet_manager.cc:1428] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent starting tablet: real 0.003s user 0.000s sys 0.000s
I20260807 19:48:15.497884 16716 ts_tablet_manager.cc:1918] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:15.498170 16716 log.cc:1196] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/0da453c0a9134a9089ecf77c6002f6e7
I20260807 19:48:15.498744 16629 tablet_bootstrap.cc:492] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: No bootstrap required, opened a new log
I20260807 19:48:15.499032 16629 ts_tablet_manager.cc:1397] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Time spent bootstrapping tablet: real 0.033s user 0.010s sys 0.002s
I20260807 19:48:15.499130 16716 ts_tablet_manager.cc:1939] T 0da453c0a9134a9089ecf77c6002f6e7 P 58e8c0b046014989a938397d63ee8ff9: Deleting consensus metadata
I20260807 19:48:15.500104 16629 raft_consensus.cc:348] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.500546 16629 raft_consensus.cc:374] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:15.500698 16629 raft_consensus.cc:729] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4c2a9053e24054969ae596489df911, State: Initialized, Role: FOLLOWER
I20260807 19:48:15.501161 16629 consensus_queue.cc:260] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.501397 15761 catalog_manager.cc:4841] TS 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531): tablet 0da453c0a9134a9089ecf77c6002f6e7 (table test-table [id=a6d3bdca220c4e0587356b49b6f5bce1]) successfully deleted
I20260807 19:48:15.502162 16629 ts_tablet_manager.cc:1428] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Time spent starting tablet: real 0.003s user 0.000s sys 0.002s
I20260807 19:48:15.717211 16646 raft_consensus.cc:482] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:15.717543 16646 raft_consensus.cc:504] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.719883 16646 leader_election.cc:288] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531), 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303)
I20260807 19:48:15.743734 16725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.720270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:36531 (local address 127.12.155.129:58005)
0807 19:48:15.733561 (+ 13291us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.733597 (+ 36us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.734541 (+ 944us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.735870 (+ 1329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.735876 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.735907 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:15.736265 (+ 358us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.736281 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.738446 (+ 2165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.738453 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.741004 (+ 2551us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.741024 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.742804 (+ 1780us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.742810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.742970 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.743009 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.743128 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.743274 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13054,"thread_start_us":15254,"threads_started":1}
I20260807 19:48:15.743710 16724 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.720431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:58005 (local address 127.12.155.130:36531)
0807 19:48:15.735160 (+ 14729us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.735167 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.735200 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:48:15.735309 (+ 109us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.735314 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.735428 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.736480 (+ 1052us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:15.736861 (+ 381us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.738249 (+ 1388us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.741206 (+ 2957us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.742580 (+ 1374us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.742786 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.742881 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.743179 (+ 298us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.743345 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14543,"thread_start_us":17709,"threads_started":1}
I20260807 19:48:15.743973 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.720374 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:49549 (local address 127.12.155.131:46303)
0807 19:48:15.720681 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.720692 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.735630 (+ 14938us) server_negotiation.cc:407] Connection header received
0807 19:48:15.736123 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.736135 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.736291 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.736416 (+ 125us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:15.737839 (+ 1423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.738933 (+ 1094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.741068 (+ 2135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.742669 (+ 1601us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.742826 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.742909 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.743464 (+ 555us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.743609 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 19:48:15.744817 16723 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.721063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:46303 (local address 127.12.155.129:49549)
0807 19:48:15.735456 (+ 14393us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.735512 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.735820 (+ 308us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.736861 (+ 1041us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.736876 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.736937 (+ 61us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:15.737578 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.737618 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.739099 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.739109 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.740910 (+ 1801us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.740923 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.743053 (+ 2130us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.743058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.743247 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.743282 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.744244 (+ 962us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.744416 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14211,"mutex_wait_us":12,"thread_start_us":12894,"threads_started":1}
I20260807 19:48:15.745163 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80886c7b0c7442f2829cda7e972fe1f6" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9" is_pre_election: true
I20260807 19:48:15.745524 16297 raft_consensus.cc:2454] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 0.
I20260807 19:48:15.745961 16530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80886c7b0c7442f2829cda7e972fe1f6" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" is_pre_election: true
I20260807 19:48:15.746165 15934 leader_election.cc:302] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e8c0b046014989a938397d63ee8ff9, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:15.746573 16530 raft_consensus.cc:2454] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 0.
I20260807 19:48:15.746742 16646 raft_consensus.cc:2781] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:15.746886 16646 raft_consensus.cc:482] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:15.746997 16646 raft_consensus.cc:3037] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:15.749593 16646 raft_consensus.cc:504] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.750366 16646 leader_election.cc:288] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 election: Requested vote from peers 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531), 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303)
I20260807 19:48:15.750984 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80886c7b0c7442f2829cda7e972fe1f6" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9"
I20260807 19:48:15.751236 16297 raft_consensus.cc:3037] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:15.751181 16530 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80886c7b0c7442f2829cda7e972fe1f6" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218"
I20260807 19:48:15.751430 16530 raft_consensus.cc:3037] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:15.754014 16297 raft_consensus.cc:2454] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 1.
I20260807 19:48:15.754494 15934 leader_election.cc:302] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e8c0b046014989a938397d63ee8ff9, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:15.754813 16646 raft_consensus.cc:2781] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:15.755335 16530 raft_consensus.cc:2454] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 1.
I20260807 19:48:15.755460 16646 raft_consensus.cc:686] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 1 LEADER]: Becoming Leader. State: Replica: eb4c2a9053e24054969ae596489df911, State: Running, Role: LEADER
I20260807 19:48:15.755949 16646 consensus_queue.cc:237] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:15.760547 15784 catalog_manager.cc:5495] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4c2a9053e24054969ae596489df911 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "eb4c2a9053e24054969ae596489df911" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } health_report { overall_health: UNKNOWN } } }
I20260807 19:48:15.797513 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.790393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42016 (local address 127.12.155.129:43753)
0807 19:48:15.791427 (+ 1034us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.791432 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.791452 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:48:15.791560 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.791564 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.791659 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.791870 (+ 211us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:15.792429 (+ 559us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.793323 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.794796 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.795248 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.795398 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.795868 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.796664 (+ 796us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.796849 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.796972 (+ 123us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.797075 (+ 103us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":907,"thread_start_us":758,"threads_started":1}
I20260807 19:48:15.817312 16684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.810879 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:33599 (local address 127.12.155.131:46303)
0807 19:48:15.811086 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.811091 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.811795 (+ 704us) server_negotiation.cc:407] Connection header received
0807 19:48:15.812068 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.812078 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.812164 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.812275 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:15.812824 (+ 549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.813643 (+ 819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.815193 (+ 1550us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.815717 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.815889 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.816399 (+ 510us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.816556 (+ 157us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.816663 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.816804 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.816909 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:48:15.817378 16731 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.810957 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:46303 (local address 127.12.155.129:33599)
0807 19:48:15.811667 (+ 710us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.811685 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.811893 (+ 208us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.812290 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.812295 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.812308 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:15.812659 (+ 351us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.812670 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.813792 (+ 1122us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.813800 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.815035 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.815049 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.815965 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.815979 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.816125 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.816191 (+ 66us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.816659 (+ 468us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.816673 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.816779 (+ 106us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.816949 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":538,"thread_start_us":360,"threads_started":1}
I20260807 19:48:15.829921 16297 raft_consensus.cc:1261] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Refusing update from remote peer eb4c2a9053e24054969ae596489df911: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:15.830703 16530 raft_consensus.cc:1261] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Refusing update from remote peer eb4c2a9053e24054969ae596489df911: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:15.831156 16726 consensus_queue.cc:1035] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:15.831691 16646 consensus_queue.cc:1035] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:15.847924 16692 mvcc.cc:205] Tried to move back new op lower bound from 7315997064512049152 to 7315997064221179904. Current Snapshot: MvccSnapshot[applied={T|T < 7315997064512049152}]
I20260807 19:48:15.850147 16690 mvcc.cc:205] Tried to move back new op lower bound from 7315997064512049152 to 7315997064221179904. Current Snapshot: MvccSnapshot[applied={T|T < 7315997064512049152}]
I20260807 19:48:15.892999 16728 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.882435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:38241 (local address 127.12.155.129:43753)
0807 19:48:15.882631 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:15.882636 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:15.886457 (+ 3821us) server_negotiation.cc:407] Connection header received
0807 19:48:15.886957 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:15.886963 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:15.887056 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:15.887160 (+ 104us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:15.887789 (+ 629us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.888766 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.890759 (+ 1993us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.891421 (+ 662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.891557 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.892064 (+ 507us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.892250 (+ 186us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.892378 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:15.892533 (+ 155us) server_negotiation.cc:299] Negotiation successful
0807 19:48:15.892631 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:48:15.893164 16738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:15.882028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43753 (local address 127.12.155.131:38241)
0807 19:48:15.886311 (+ 4283us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:15.886336 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:15.886725 (+ 389us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:15.887177 (+ 452us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:15.887182 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:15.887195 (+ 13us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:48:15.887635 (+ 440us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.887651 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.888925 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.888931 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.890536 (+ 1605us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:15.890555 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:15.891568 (+ 1013us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:15.891574 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:15.891759 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:15.891848 (+ 89us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:48:15.892383 (+ 535us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:48:15.892394 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:48:15.892496 (+ 102us) client_negotiation.cc:240] Negotiation successful
0807 19:48:15.892665 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4091,"thread_start_us":3797,"threads_started":1}
W20260807 19:48:15.895081 16692 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 19:48:17.539566 15783 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:17.539994 15783 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41706:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:17.545320 15783 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Sending DeleteTablet for 3 replicas of tablet 80886c7b0c7442f2829cda7e972fe1f6
I20260807 19:48:17.546432 16020 tablet_service.cc:1514] Processing DeleteTablet for tablet 80886c7b0c7442f2829cda7e972fe1f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:17 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42004
I20260807 19:48:17.546604 16257 tablet_service.cc:1514] Processing DeleteTablet for tablet 80886c7b0c7442f2829cda7e972fe1f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:17 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:59362
I20260807 19:48:17.546746 16485 tablet_service.cc:1514] Processing DeleteTablet for tablet 80886c7b0c7442f2829cda7e972fe1f6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:17 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:58670
I20260807 19:48:17.559504 16778 tablet_replica.cc:330] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: stopping tablet replica
I20260807 19:48:17.559576 16779 tablet_replica.cc:330] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: stopping tablet replica
I20260807 19:48:17.559875 16779 raft_consensus.cc:2229] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:17.559963 16778 raft_consensus.cc:2229] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:17.560477 16779 raft_consensus.cc:2258] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:17.560976 16778 raft_consensus.cc:2258] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:17.562038 16782 tablet_replica.cc:330] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: stopping tablet replica
I20260807 19:48:17.562785 16779 ts_tablet_manager.cc:1905] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:17.563040 16778 ts_tablet_manager.cc:1905] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:17.563225 16782 raft_consensus.cc:2229] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:17.563637 16782 raft_consensus.cc:2258] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:17.564927 16782 ts_tablet_manager.cc:1905] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:17.572479 16778 ts_tablet_manager.cc:1918] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:48:17.572479 16779 ts_tablet_manager.cc:1918] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:48:17.572676 16779 log.cc:1196] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/80886c7b0c7442f2829cda7e972fe1f6
I20260807 19:48:17.572830 16778 log.cc:1196] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/80886c7b0c7442f2829cda7e972fe1f6
I20260807 19:48:17.573415 16779 ts_tablet_manager.cc:1939] T 80886c7b0c7442f2829cda7e972fe1f6 P 58e8c0b046014989a938397d63ee8ff9: Deleting consensus metadata
I20260807 19:48:17.573513 16778 ts_tablet_manager.cc:1939] T 80886c7b0c7442f2829cda7e972fe1f6 P eb4c2a9053e24054969ae596489df911: Deleting consensus metadata
I20260807 19:48:17.574038 16782 ts_tablet_manager.cc:1918] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:48:17.574409 16782 log.cc:1196] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/80886c7b0c7442f2829cda7e972fe1f6
I20260807 19:48:17.575126 16782 ts_tablet_manager.cc:1939] T 80886c7b0c7442f2829cda7e972fe1f6 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting consensus metadata
I20260807 19:48:17.575376 15761 catalog_manager.cc:4841] TS eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753): tablet 80886c7b0c7442f2829cda7e972fe1f6 (table test-table [id=7c94ed5e774b4d5e9c711886c9b3935a]) successfully deleted
I20260807 19:48:17.575740 15761 catalog_manager.cc:4841] TS 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531): tablet 80886c7b0c7442f2829cda7e972fe1f6 (table test-table [id=7c94ed5e774b4d5e9c711886c9b3935a]) successfully deleted
I20260807 19:48:17.576553 15760 catalog_manager.cc:4841] TS 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303): tablet 80886c7b0c7442f2829cda7e972fe1f6 (table test-table [id=7c94ed5e774b4d5e9c711886c9b3935a]) successfully deleted
Aug 07 19:48:17 dist-test-slave-2p8l krb5kdc[15712](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132097, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:48:17 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132097, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:17.624656 16803 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:17.607658 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45562 (local address 127.12.155.190:42733)
0807 19:48:17.608557 (+ 899us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:17.608562 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:17.608586 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:48:17.608659 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:17.608664 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:17.608735 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:17.608853 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:17.610789 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:17.611672 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:17.612965 (+ 1293us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:17.613397 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:17.613496 (+ 99us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:17.618124 (+ 4628us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:17.618131 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:17.618135 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:17.618183 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:17.621303 (+ 3120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:17.622211 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:17.622216 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:17.622219 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:17.622367 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:17.622758 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:17.622761 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:17.622764 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:17.623161 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:17.623541 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:17.623803 (+ 262us) server_negotiation.cc:299] Negotiation successful
0807 19:48:17.624051 (+ 248us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":592,"threads_started":1}
I20260807 19:48:17.629222 15783 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:17.630044 15783 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:17.637833 16020 tablet_service.cc:1467] Processing CreateTablet for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 (DEFAULT_TABLE table=test-table [id=731d995a70aa481babe2479e8a67da58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:17.637843 16257 tablet_service.cc:1467] Processing CreateTablet for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 (DEFAULT_TABLE table=test-table [id=731d995a70aa481babe2479e8a67da58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:17.637866 16485 tablet_service.cc:1467] Processing CreateTablet for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 (DEFAULT_TABLE table=test-table [id=731d995a70aa481babe2479e8a67da58]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:17.638490 16485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:17.638459 16020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:17.638550 16257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:17.646049 16804 tablet_bootstrap.cc:492] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Bootstrap starting.
I20260807 19:48:17.646968 16805 tablet_bootstrap.cc:492] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Bootstrap starting.
I20260807 19:48:17.648140 16807 tablet_bootstrap.cc:492] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Bootstrap starting.
I20260807 19:48:17.649431 16805 tablet_bootstrap.cc:654] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:17.649673 16804 tablet_bootstrap.cc:654] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:17.650565 16807 tablet_bootstrap.cc:654] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:17.658749 16805 tablet_bootstrap.cc:492] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: No bootstrap required, opened a new log
I20260807 19:48:17.658972 16805 ts_tablet_manager.cc:1397] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260807 19:48:17.659049 16804 tablet_bootstrap.cc:492] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: No bootstrap required, opened a new log
I20260807 19:48:17.659399 16804 ts_tablet_manager.cc:1397] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.007s
I20260807 19:48:17.660094 16807 tablet_bootstrap.cc:492] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: No bootstrap required, opened a new log
I20260807 19:48:17.660007 16805 raft_consensus.cc:348] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.660300 16805 raft_consensus.cc:374] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:17.660310 16807 ts_tablet_manager.cc:1397] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Time spent bootstrapping tablet: real 0.012s user 0.003s sys 0.008s
I20260807 19:48:17.660411 16805 raft_consensus.cc:729] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e8c0b046014989a938397d63ee8ff9, State: Initialized, Role: FOLLOWER
I20260807 19:48:17.660732 16805 consensus_queue.cc:260] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.660601 16804 raft_consensus.cc:348] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.660965 16804 raft_consensus.cc:374] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:17.661116 16804 raft_consensus.cc:729] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Initialized, Role: FOLLOWER
I20260807 19:48:17.661510 16804 consensus_queue.cc:260] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.661643 16807 raft_consensus.cc:348] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.661904 16807 raft_consensus.cc:374] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:17.662000 16807 raft_consensus.cc:729] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4c2a9053e24054969ae596489df911, State: Initialized, Role: FOLLOWER
I20260807 19:48:17.662233 16804 ts_tablet_manager.cc:1428] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent starting tablet: real 0.003s user 0.001s sys 0.001s
I20260807 19:48:17.662489 16805 ts_tablet_manager.cc:1428] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:17.662331 16807 consensus_queue.cc:260] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.662987 16807 ts_tablet_manager.cc:1428] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 19:48:17.819690 16748 raft_consensus.cc:482] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:17.820052 16748 raft_consensus.cc:504] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.821069 16748 leader_election.cc:288] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753), 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531)
I20260807 19:48:17.822270 16046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e89109d3bb43ccb4d0b8b950bfc0e5" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4c2a9053e24054969ae596489df911" is_pre_election: true
I20260807 19:48:17.822491 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e89109d3bb43ccb4d0b8b950bfc0e5" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9" is_pre_election: true
I20260807 19:48:17.822703 16046 raft_consensus.cc:2454] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 0.
I20260807 19:48:17.823022 16297 raft_consensus.cc:2454] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 0.
I20260807 19:48:17.823578 16399 leader_election.cc:302] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c3e2c4f05b74ef7bcd3e722d8758218, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:17.824066 16748 raft_consensus.cc:2781] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:17.824370 16748 raft_consensus.cc:482] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:17.824600 16748 raft_consensus.cc:3037] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:17.828016 16748 raft_consensus.cc:504] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.828838 16748 leader_election.cc:288] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 election: Requested vote from peers eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753), 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531)
I20260807 19:48:17.829736 16046 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e89109d3bb43ccb4d0b8b950bfc0e5" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "eb4c2a9053e24054969ae596489df911"
I20260807 19:48:17.829805 16297 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "02e89109d3bb43ccb4d0b8b950bfc0e5" candidate_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9"
I20260807 19:48:17.830140 16046 raft_consensus.cc:3037] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:17.830195 16297 raft_consensus.cc:3037] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:17.833602 16297 raft_consensus.cc:2454] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 1.
I20260807 19:48:17.834370 16399 leader_election.cc:302] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e8c0b046014989a938397d63ee8ff9, 5c3e2c4f05b74ef7bcd3e722d8758218; no voters:
I20260807 19:48:17.834744 16046 raft_consensus.cc:2454] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5c3e2c4f05b74ef7bcd3e722d8758218 in term 1.
I20260807 19:48:17.834933 16748 raft_consensus.cc:2781] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:17.835093 16748 raft_consensus.cc:686] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 LEADER]: Becoming Leader. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Running, Role: LEADER
I20260807 19:48:17.835441 16748 consensus_queue.cc:237] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:17.839193 15784 catalog_manager.cc:5495] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } health_report { overall_health: HEALTHY } } }
I20260807 19:48:17.907574 16816 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:17.900432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57698 (local address 127.12.155.131:46303)
0807 19:48:17.901200 (+ 768us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:17.901205 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:17.901240 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:48:17.901300 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:17.901304 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:17.901375 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:17.901503 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:17.902237 (+ 734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:17.903451 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:17.905396 (+ 1945us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:17.905879 (+ 483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:17.906040 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:17.906684 (+ 644us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:17.906812 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:17.906930 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:17.907098 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 19:48:17.907187 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":575,"thread_start_us":376,"threads_started":1}
I20260807 19:48:17.919072 16297 raft_consensus.cc:1261] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Refusing update from remote peer 5c3e2c4f05b74ef7bcd3e722d8758218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:17.919178 16046 raft_consensus.cc:1261] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Refusing update from remote peer 5c3e2c4f05b74ef7bcd3e722d8758218: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:17.919770 16748 consensus_queue.cc:1035] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:17.920243 16642 consensus_queue.cc:1035] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [LEADER]: Connected to new peer: Peer: permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:17.973254 15780 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:17.973662 15780 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:17.977653 15780 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Sending DeleteTablet for 3 replicas of tablet 02e89109d3bb43ccb4d0b8b950bfc0e5
I20260807 19:48:17.978852 16020 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:17 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42004
I20260807 19:48:17.978946 16257 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:17 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:59362
I20260807 19:48:17.979017 16485 tablet_service.cc:1514] Processing DeleteTablet for tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:17 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:58670
I20260807 19:48:17.979305 16778 tablet_replica.cc:330] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: stopping tablet replica
I20260807 19:48:17.979331 16782 tablet_replica.cc:330] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: stopping tablet replica
I20260807 19:48:17.979426 16779 tablet_replica.cc:330] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: stopping tablet replica
I20260807 19:48:17.979609 16782 raft_consensus.cc:2229] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:17.979671 16778 raft_consensus.cc:2229] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:17.979818 16779 raft_consensus.cc:2229] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:17.980047 16778 raft_consensus.cc:2258] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:17.980064 16782 raft_consensus.cc:2258] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:17.980130 16779 raft_consensus.cc:2258] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:17.981427 16782 ts_tablet_manager.cc:1905] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:17.981536 16779 ts_tablet_manager.cc:1905] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:17.981936 16778 ts_tablet_manager.cc:1905] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:17.982107 15780 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45562:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:17.982991 15780 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:17.989312 16782 ts_tablet_manager.cc:1918] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:17.989555 16782 log.cc:1196] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/02e89109d3bb43ccb4d0b8b950bfc0e5
I20260807 19:48:17.989622 16778 ts_tablet_manager.cc:1918] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:17.989935 16778 log.cc:1196] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/02e89109d3bb43ccb4d0b8b950bfc0e5
I20260807 19:48:17.990187 16782 ts_tablet_manager.cc:1939] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting consensus metadata
I20260807 19:48:17.990607 16778 ts_tablet_manager.cc:1939] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P eb4c2a9053e24054969ae596489df911: Deleting consensus metadata
I20260807 19:48:17.990640 16779 ts_tablet_manager.cc:1918] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:48:17.990993 16779 log.cc:1196] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/02e89109d3bb43ccb4d0b8b950bfc0e5
I20260807 19:48:17.991556 16779 ts_tablet_manager.cc:1939] T 02e89109d3bb43ccb4d0b8b950bfc0e5 P 58e8c0b046014989a938397d63ee8ff9: Deleting consensus metadata
I20260807 19:48:17.991720 15760 catalog_manager.cc:4841] TS 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303): tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 (table test-table [id=731d995a70aa481babe2479e8a67da58]) successfully deleted
I20260807 19:48:17.992607 15761 catalog_manager.cc:4841] TS eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753): tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 (table test-table [id=731d995a70aa481babe2479e8a67da58]) successfully deleted
I20260807 19:48:17.993170 16020 tablet_service.cc:1467] Processing CreateTablet for tablet 46ca0e3ab4af4e6b99646cd5a6d46797 (DEFAULT_TABLE table=test-table [id=82e5cf199a014af6bd017f94d875e938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:17.993435 16257 tablet_service.cc:1467] Processing CreateTablet for tablet 46ca0e3ab4af4e6b99646cd5a6d46797 (DEFAULT_TABLE table=test-table [id=82e5cf199a014af6bd017f94d875e938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:17.993432 16485 tablet_service.cc:1467] Processing CreateTablet for tablet 46ca0e3ab4af4e6b99646cd5a6d46797 (DEFAULT_TABLE table=test-table [id=82e5cf199a014af6bd017f94d875e938]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:17.993719 16020 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ca0e3ab4af4e6b99646cd5a6d46797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:17.993883 16257 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ca0e3ab4af4e6b99646cd5a6d46797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:17.993901 16485 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 46ca0e3ab4af4e6b99646cd5a6d46797. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:17.994251 15761 catalog_manager.cc:4841] TS 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531): tablet 02e89109d3bb43ccb4d0b8b950bfc0e5 (table test-table [id=731d995a70aa481babe2479e8a67da58]) successfully deleted
I20260807 19:48:18.001374 16807 tablet_bootstrap.cc:492] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Bootstrap starting.
I20260807 19:48:18.001658 16805 tablet_bootstrap.cc:492] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Bootstrap starting.
I20260807 19:48:18.001825 16804 tablet_bootstrap.cc:492] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Bootstrap starting.
I20260807 19:48:18.003820 16804 tablet_bootstrap.cc:654] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:18.003796 16805 tablet_bootstrap.cc:654] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:18.004657 16807 tablet_bootstrap.cc:654] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:18.008522 16805 tablet_bootstrap.cc:492] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: No bootstrap required, opened a new log
I20260807 19:48:18.008718 16805 ts_tablet_manager.cc:1397] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Time spent bootstrapping tablet: real 0.007s user 0.005s sys 0.000s
I20260807 19:48:18.009090 16804 tablet_bootstrap.cc:492] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: No bootstrap required, opened a new log
I20260807 19:48:18.009317 16804 ts_tablet_manager.cc:1397] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.001s
I20260807 19:48:18.009914 16807 tablet_bootstrap.cc:492] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: No bootstrap required, opened a new log
I20260807 19:48:18.009814 16805 raft_consensus.cc:348] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.010243 16805 raft_consensus.cc:374] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:18.010335 16807 ts_tablet_manager.cc:1397] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 19:48:18.010429 16805 raft_consensus.cc:729] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 58e8c0b046014989a938397d63ee8ff9, State: Initialized, Role: FOLLOWER
I20260807 19:48:18.010776 16805 consensus_queue.cc:260] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.011364 16805 ts_tablet_manager.cc:1428] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:18.011909 16804 raft_consensus.cc:348] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.012233 16804 raft_consensus.cc:374] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:18.012351 16804 raft_consensus.cc:729] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5c3e2c4f05b74ef7bcd3e722d8758218, State: Initialized, Role: FOLLOWER
I20260807 19:48:18.012399 16807 raft_consensus.cc:348] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.012705 16807 raft_consensus.cc:374] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:18.012629 16804 consensus_queue.cc:260] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.012835 16807 raft_consensus.cc:729] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eb4c2a9053e24054969ae596489df911, State: Initialized, Role: FOLLOWER
I20260807 19:48:18.013267 16804 ts_tablet_manager.cc:1428] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Time spent starting tablet: real 0.004s user 0.000s sys 0.003s
I20260807 19:48:18.013180 16807 consensus_queue.cc:260] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.013936 16807 ts_tablet_manager.cc:1428] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:18.051687 16743 raft_consensus.cc:482] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:18.052073 16743 raft_consensus.cc:504] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.053328 16743 leader_election.cc:288] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531), 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303)
I20260807 19:48:18.054139 16295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ca0e3ab4af4e6b99646cd5a6d46797" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9" is_pre_election: true
I20260807 19:48:18.054188 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ca0e3ab4af4e6b99646cd5a6d46797" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" is_pre_election: true
I20260807 19:48:18.054466 16295 raft_consensus.cc:2454] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 0.
I20260807 19:48:18.054562 16529 raft_consensus.cc:2454] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 0.
I20260807 19:48:18.055016 15934 leader_election.cc:302] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 58e8c0b046014989a938397d63ee8ff9, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:18.055413 16743 raft_consensus.cc:2781] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:18.055635 16743 raft_consensus.cc:482] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:18.055788 16743 raft_consensus.cc:3037] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:18.058718 16743 raft_consensus.cc:504] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.059579 16743 leader_election.cc:288] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 election: Requested vote from peers 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531), 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303)
I20260807 19:48:18.060331 16529 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ca0e3ab4af4e6b99646cd5a6d46797" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218"
I20260807 19:48:18.060360 16295 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46ca0e3ab4af4e6b99646cd5a6d46797" candidate_uuid: "eb4c2a9053e24054969ae596489df911" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "58e8c0b046014989a938397d63ee8ff9"
I20260807 19:48:18.060705 16529 raft_consensus.cc:3037] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:18.060746 16295 raft_consensus.cc:3037] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:18.063418 16529 raft_consensus.cc:2454] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 1.
I20260807 19:48:18.064069 16295 raft_consensus.cc:2454] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate eb4c2a9053e24054969ae596489df911 in term 1.
I20260807 19:48:18.064110 15932 leader_election.cc:302] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5c3e2c4f05b74ef7bcd3e722d8758218, eb4c2a9053e24054969ae596489df911; no voters:
I20260807 19:48:18.064579 16743 raft_consensus.cc:2781] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:18.065533 16743 raft_consensus.cc:686] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 1 LEADER]: Becoming Leader. State: Replica: eb4c2a9053e24054969ae596489df911, State: Running, Role: LEADER
I20260807 19:48:18.065973 16743 consensus_queue.cc:237] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } }
I20260807 19:48:18.069674 15784 catalog_manager.cc:5495] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 reported cstate change: term changed from 0 to 1, leader changed from <none> to eb4c2a9053e24054969ae596489df911 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "eb4c2a9053e24054969ae596489df911" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "eb4c2a9053e24054969ae596489df911" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43753 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 } health_report { overall_health: UNKNOWN } } }
I20260807 19:48:18.107205 16830 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:18.100732 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55542 (local address 127.12.155.129:43753)
0807 19:48:18.101645 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:18.101652 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:18.101682 (+ 30us) server_negotiation.cc:407] Connection header received
0807 19:48:18.101790 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:18.101795 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:18.101889 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:18.102009 (+ 120us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:18.102600 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:18.103713 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:18.105186 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:18.105640 (+ 454us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:18.105799 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:18.106329 (+ 530us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:18.106454 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:18.106567 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:18.106731 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 19:48:18.106823 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":740,"thread_start_us":551,"threads_started":1}
I20260807 19:48:18.118157 16529 raft_consensus.cc:1261] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Refusing update from remote peer eb4c2a9053e24054969ae596489df911: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:18.118464 16295 raft_consensus.cc:1261] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Refusing update from remote peer eb4c2a9053e24054969ae596489df911: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:18.119093 16828 consensus_queue.cc:1035] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5c3e2c4f05b74ef7bcd3e722d8758218" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 46303 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:18.119602 16743 consensus_queue.cc:1035] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [LEADER]: Connected to new peer: Peer: permanent_uuid: "58e8c0b046014989a938397d63ee8ff9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36531 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:48:18.144174 16750 tablet_replica.cc:1298] Aborted: operation has been aborted: cancelling pending write operations
I20260807 19:48:19.755445 15780 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:19.755755 15780 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:45562:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:19.761349 15780 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9bab00c11fb24610b13edb69166d33c1: Sending DeleteTablet for 3 replicas of tablet 46ca0e3ab4af4e6b99646cd5a6d46797
I20260807 19:48:19.762328 16020 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ca0e3ab4af4e6b99646cd5a6d46797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:19 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42004
I20260807 19:48:19.762586 16485 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ca0e3ab4af4e6b99646cd5a6d46797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:19 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:58670
I20260807 19:48:19.762666 16257 tablet_service.cc:1514] Processing DeleteTablet for tablet 46ca0e3ab4af4e6b99646cd5a6d46797 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:19 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:59362
I20260807 19:48:19.764272 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15905
I20260807 19:48:19.764688 16891 tablet_replica.cc:330] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: stopping tablet replica
I20260807 19:48:19.764940 16883 tablet_replica.cc:330] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: stopping tablet replica
I20260807 19:48:19.765028 16891 raft_consensus.cc:2229] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:19.765282 16883 raft_consensus.cc:2229] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:19.765439 16891 raft_consensus.cc:2258] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:19.765915 16883 raft_consensus.cc:2258] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:19.767048 16891 ts_tablet_manager.cc:1905] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:19.767149 16883 ts_tablet_manager.cc:1905] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:19.775110 16891 ts_tablet_manager.cc:1918] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:48:19.775092 16883 ts_tablet_manager.cc:1918] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:48:19.775266 16883 log.cc:1196] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/46ca0e3ab4af4e6b99646cd5a6d46797
I20260807 19:48:19.775367 16891 log.cc:1196] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/46ca0e3ab4af4e6b99646cd5a6d46797
I20260807 19:48:19.775700 16886 tablet_replica.cc:330] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: stopping tablet replica
I20260807 19:48:19.775906 16883 ts_tablet_manager.cc:1939] T 46ca0e3ab4af4e6b99646cd5a6d46797 P eb4c2a9053e24054969ae596489df911: Deleting consensus metadata
I20260807 19:48:19.776479 16891 ts_tablet_manager.cc:1939] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 58e8c0b046014989a938397d63ee8ff9: Deleting consensus metadata
I20260807 19:48:19.776891 16886 raft_consensus.cc:2229] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:19.777307 16886 raft_consensus.cc:2258] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:19.777842 15761 catalog_manager.cc:4841] TS eb4c2a9053e24054969ae596489df911 (127.12.155.129:43753): tablet 46ca0e3ab4af4e6b99646cd5a6d46797 (table test-table [id=82e5cf199a014af6bd017f94d875e938]) successfully deleted
I20260807 19:48:19.778821 15761 catalog_manager.cc:4841] TS 58e8c0b046014989a938397d63ee8ff9 (127.12.155.130:36531): tablet 46ca0e3ab4af4e6b99646cd5a6d46797 (table test-table [id=82e5cf199a014af6bd017f94d875e938]) successfully deleted
I20260807 19:48:19.779523 16886 ts_tablet_manager.cc:1905] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:19.785610 16886 ts_tablet_manager.cc:1918] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.8
I20260807 19:48:19.785849 16886 log.cc:1196] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TxnSmokeWithDifferentUserTypes.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/46ca0e3ab4af4e6b99646cd5a6d46797
I20260807 19:48:19.786428 16886 ts_tablet_manager.cc:1939] T 46ca0e3ab4af4e6b99646cd5a6d46797 P 5c3e2c4f05b74ef7bcd3e722d8758218: Deleting consensus metadata
I20260807 19:48:19.787768 15760 catalog_manager.cc:4841] TS 5c3e2c4f05b74ef7bcd3e722d8758218 (127.12.155.131:46303): tablet 46ca0e3ab4af4e6b99646cd5a6d46797 (table test-table [id=82e5cf199a014af6bd017f94d875e938]) successfully deleted
Aug 07 19:48:19 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132097, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:19.805099 16894 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:19.766621 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55554 (local address 127.12.155.129:43753)
0807 19:48:19.777794 (+ 11173us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:19.777806 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:19.778673 (+ 867us) server_negotiation.cc:407] Connection header received
0807 19:48:19.779100 (+ 427us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:19.779107 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:19.779226 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:19.779310 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:19.781689 (+ 2379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:19.782970 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:19.784862 (+ 1892us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:19.785349 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:19.785512 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:19.796417 (+ 10905us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:19.796447 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:19.796472 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:19.796532 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:19.800717 (+ 4185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:19.801642 (+ 925us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:19.801652 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:19.801655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:19.802011 (+ 356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:19.802558 (+ 547us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:19.802566 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:19.802574 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:19.803191 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:19.803682 (+ 491us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:19.803997 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 19:48:19.804346 (+ 349us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10925,"thread_start_us":11218,"threads_started":1}
W20260807 19:48:19.806273 16122 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:55554
W20260807 19:48:19.807196 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15905: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:19.807564 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15905
I20260807 19:48:19.851413 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16138
Aug 07 19:48:19 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132097, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:19.871551 16896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:19.852577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50500 (local address 127.12.155.130:36531)
0807 19:48:19.853332 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:19.853337 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:19.853353 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:48:19.853431 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:19.853435 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:19.853509 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:19.853649 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:19.855235 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:19.856232 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:19.857681 (+ 1449us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:19.858431 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:19.858601 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:19.863647 (+ 5046us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:19.863670 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:19.863694 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:19.863747 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:19.867952 (+ 4205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:19.868710 (+ 758us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:19.868721 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:19.868723 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:19.868899 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:19.869235 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:19.869244 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:19.869246 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:19.869950 (+ 704us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:19.870351 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:19.870863 (+ 512us) server_negotiation.cc:299] Negotiation successful
0807 19:48:19.871147 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":606,"thread_start_us":353,"threads_started":1}
W20260807 19:48:19.872522 16357 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:50500
W20260807 19:48:19.873421 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16138: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:19.873699 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16138
I20260807 19:48:19.912814 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16369
Aug 07 19:48:19 dist-test-slave-2p8l krb5kdc[15712](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132097, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:19.932420 16898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:19.914043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57714 (local address 127.12.155.131:46303)
0807 19:48:19.914924 (+ 881us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:19.914930 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:19.914951 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:48:19.915028 (+ 77us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:19.915033 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:19.915117 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:19.915239 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:19.916865 (+ 1626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:19.917864 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:19.919362 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:19.919926 (+ 564us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:19.920052 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:19.925426 (+ 5374us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:19.925449 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:19.925473 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:19.925519 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:19.928831 (+ 3312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:19.929649 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:19.929660 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:19.929662 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:19.929847 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:19.930409 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:19.930414 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:19.930417 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:19.930905 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:19.931171 (+ 266us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:19.931578 (+ 407us) server_negotiation.cc:299] Negotiation successful
0807 19:48:19.931863 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":744,"thread_start_us":439,"threads_started":1}
W20260807 19:48:19.933328 16595 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:57714
W20260807 19:48:19.934154 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16369: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:19.934397 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16369
I20260807 19:48:19.975345 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15735
I20260807 19:48:19.977175 15856 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:20.116127 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15735
2026-08-07T19:48:20Z chronyd exiting
[ OK ] SecurityITest.TxnSmokeWithDifferentUserTypes (9937 ms)
[ RUN ] SecurityITest.TestNoKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:20 dist-test-slave-2p8l krb5kdc[16906](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:20 dist-test-slave-2p8l krb5kdc[16906](info): set up 2 sockets
Aug 07 19:48:20 dist-test-slave-2p8l krb5kdc[16906](info): commencing operation
krb5kdc: starting...
W20260807 19:48:21.540151 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.002s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:21 dist-test-slave-2p8l krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:21.814592 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43609
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43609
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:22.233517 16922 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:22.233968 16922 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:22.234163 16922 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:22.242218 16922 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:22.242391 16922 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:22.242509 16922 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:22.242614 16922 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:22.242702 16922 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:22.254276 16922 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43609
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43609
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:22.256136 16922 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:22.257836 16922 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:22.272557 16930 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:22.272580 16933 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:22.272650 16931 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:22.273690 16922 server_base.cc:1034] running on GCE node
I20260807 19:48:22.274729 16922 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:22.276530 16922 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:22.277782 16922 hybrid_clock.cc:648] HybridClock initialized: now 1786132102277727 us; error 43 us; skew 500 ppm
I20260807 19:48:22.278296 16922 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:22 dist-test-slave-2p8l krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132102, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:22.281962 16922 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:22.283885 16922 webserver.cc:460] Webserver started at http://127.12.155.190:39193/ using document root <none> and password file <none>
I20260807 19:48:22.284758 16922 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:22.284915 16922 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:22.285295 16922 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:22.289041 16922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "eaada48b46e3453f9a47d85b5fb27ed7"
format_stamp: "Formatted at 2026-08-07 19:48:22 on dist-test-slave-2p8l"
server_key: "18fcbf0bdf4179b64bf8d249d6b6be7a"
server_key_iv: "a50b669bf0042fe1bfb16940b2d658f4"
server_key_version: "encryptionkey@0"
I20260807 19:48:22.289935 16922 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "eaada48b46e3453f9a47d85b5fb27ed7"
format_stamp: "Formatted at 2026-08-07 19:48:22 on dist-test-slave-2p8l"
server_key: "18fcbf0bdf4179b64bf8d249d6b6be7a"
server_key_iv: "a50b669bf0042fe1bfb16940b2d658f4"
server_key_version: "encryptionkey@0"
I20260807 19:48:22.296490 16922 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:22.300684 16943 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:22.302343 16922 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:22.302580 16922 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "eaada48b46e3453f9a47d85b5fb27ed7"
format_stamp: "Formatted at 2026-08-07 19:48:22 on dist-test-slave-2p8l"
server_key: "18fcbf0bdf4179b64bf8d249d6b6be7a"
server_key_iv: "a50b669bf0042fe1bfb16940b2d658f4"
server_key_version: "encryptionkey@0"
I20260807 19:48:22.302821 16922 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:22.321169 16922 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:22.326032 16922 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:22.326483 16922 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:22.348691 16922 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43609
I20260807 19:48:22.348713 17023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43609 every 8 connection(s)
I20260807 19:48:22.350518 16922 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:22.355562 17025 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:22.355764 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16922
I20260807 19:48:22.356047 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:22.356810 12910 external_mini_cluster.cc:1428] Setting key 32d69521f56b539c61d2f863fc9c9450
I20260807 19:48:22.373013 17025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7: Bootstrap starting.
Aug 07 19:48:22 dist-test-slave-2p8l krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132101, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:22.377847 17025 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:22.379462 17025 log.cc:824] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:22.383399 17025 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7: No bootstrap required, opened a new log
I20260807 19:48:22.385123 17030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:22.359227 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59972 (local address 127.12.155.190:43609)
0807 19:48:22.360180 (+ 953us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:22.360195 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:22.360247 (+ 52us) server_negotiation.cc:407] Connection header received
0807 19:48:22.363002 (+ 2755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:22.363036 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:22.363519 (+ 483us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:22.363910 (+ 391us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:22.366316 (+ 2406us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:22.367765 (+ 1449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:22.369835 (+ 2070us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:22.370664 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:22.370815 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:22.376434 (+ 5619us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:22.376445 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:22.376463 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:22.376511 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:22.380343 (+ 3832us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:22.381154 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:22.381161 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:22.381169 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:22.381359 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:22.381809 (+ 450us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:22.381818 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:22.381820 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:22.382515 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:22.382883 (+ 368us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:22.383375 (+ 492us) server_negotiation.cc:299] Negotiation successful
0807 19:48:22.383898 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":698,"thread_start_us":450,"threads_started":1}
I20260807 19:48:22.392895 17025 raft_consensus.cc:348] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43609 } }
I20260807 19:48:22.393472 17025 raft_consensus.cc:374] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:22.393606 17025 raft_consensus.cc:729] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: eaada48b46e3453f9a47d85b5fb27ed7, State: Initialized, Role: FOLLOWER
I20260807 19:48:22.394438 17025 consensus_queue.cc:260] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43609 } }
I20260807 19:48:22.394816 17025 raft_consensus.cc:388] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:22.395025 17025 raft_consensus.cc:482] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:22.395262 17025 raft_consensus.cc:3037] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:22.397950 17025 raft_consensus.cc:504] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43609 } }
I20260807 19:48:22.398705 17025 leader_election.cc:302] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: eaada48b46e3453f9a47d85b5fb27ed7; no voters:
I20260807 19:48:22.399430 17025 leader_election.cc:288] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:22.399576 17033 raft_consensus.cc:2781] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:22.401302 17033 raft_consensus.cc:686] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [term 1 LEADER]: Becoming Leader. State: Replica: eaada48b46e3453f9a47d85b5fb27ed7, State: Running, Role: LEADER
I20260807 19:48:22.401925 17033 consensus_queue.cc:237] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43609 } }
I20260807 19:48:22.402469 17025 sys_catalog.cc:564] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:22.405563 17035 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader eaada48b46e3453f9a47d85b5fb27ed7. Latest consensus state: current_term: 1 leader_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43609 } } }
I20260807 19:48:22.405413 17034 sys_catalog.cc:455] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "eaada48b46e3453f9a47d85b5fb27ed7" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43609 } } }
I20260807 19:48:22.405972 17034 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:22.405972 17035 sys_catalog.cc:458] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:22.407089 17047 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:22.414178 17047 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:22.425967 17047 catalog_manager.cc:1347] Generated new cluster ID: 9efbc97529314af3b85960e839ac0f30
I20260807 19:48:22.426167 17047 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:22.442217 17047 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:22.444398 17047 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:22.464022 17047 catalog_manager.cc:5868] T 00000000000000000000000000000000 P eaada48b46e3453f9a47d85b5fb27ed7: Generated new TSK 0
I20260807 19:48:22.465474 17047 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:22.539240 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43609
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:22.973917 17070 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:22.974363 17070 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:22.974476 17070 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:22.983003 17070 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:22.983155 17070 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:22.983286 17070 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:22.994557 17070 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:22.996378 17070 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:22.998132 17070 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:23.015369 17077 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:23.015420 17084 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:23.015446 17078 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:23.020133 17070 server_base.cc:1034] running on GCE node
I20260807 19:48:23.021167 17070 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:23.022646 17070 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:23.024012 17070 hybrid_clock.cc:648] HybridClock initialized: now 1786132103023934 us; error 65 us; skew 500 ppm
I20260807 19:48:23.024483 17070 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:23 dist-test-slave-2p8l krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:23.029124 17070 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:23.031221 17070 webserver.cc:460] Webserver started at http://127.12.155.129:42155/ using document root <none> and password file <none>
I20260807 19:48:23.032148 17070 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:23.032262 17070 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:23.032583 17070 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:23.036228 17070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "f7fdb0c13b2947229b960aa4301ebb1e"
format_stamp: "Formatted at 2026-08-07 19:48:23 on dist-test-slave-2p8l"
server_key: "db2e7f931c4257369831e3da3e984909"
server_key_iv: "1ea22474ef5a2af435a42af1938ad88e"
server_key_version: "encryptionkey@0"
I20260807 19:48:23.037102 17070 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "f7fdb0c13b2947229b960aa4301ebb1e"
format_stamp: "Formatted at 2026-08-07 19:48:23 on dist-test-slave-2p8l"
server_key: "db2e7f931c4257369831e3da3e984909"
server_key_iv: "1ea22474ef5a2af435a42af1938ad88e"
server_key_version: "encryptionkey@0"
I20260807 19:48:23.043702 17070 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 19:48:23.050940 17096 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:23.053280 17070 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.002s sys 0.003s
I20260807 19:48:23.053573 17070 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "f7fdb0c13b2947229b960aa4301ebb1e"
format_stamp: "Formatted at 2026-08-07 19:48:23 on dist-test-slave-2p8l"
server_key: "db2e7f931c4257369831e3da3e984909"
server_key_iv: "1ea22474ef5a2af435a42af1938ad88e"
server_key_version: "encryptionkey@0"
I20260807 19:48:23.053946 17070 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:23.072163 17070 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:23.077503 17070 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:23.077816 17070 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:23.079180 17070 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:23.081048 17070 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:23.081135 17070 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:23.081254 17070 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:23.081302 17070 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:23.125808 17070 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:46101
I20260807 19:48:23.125979 17295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:46101 every 8 connection(s)
I20260807 19:48:23.127588 17070 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:23.135265 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17070
I20260807 19:48:23.135587 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:23.136423 12910 external_mini_cluster.cc:1428] Setting key f10455b936687d1cb21bc9f014b26323
Aug 07 19:48:23 dist-test-slave-2p8l krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:23.151440 17299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:23.130994 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:46473 (local address 127.12.155.190:43609)
0807 19:48:23.131597 (+ 603us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:23.131605 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:23.132867 (+ 1262us) server_negotiation.cc:407] Connection header received
0807 19:48:23.135132 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:23.135142 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:23.135271 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:23.135475 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:23.137416 (+ 1941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.138326 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.140067 (+ 1741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.140520 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.140664 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:23.144872 (+ 4208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:23.144877 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:23.144881 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:23.144915 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:23.147893 (+ 2978us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:23.148718 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:23.148725 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:23.148729 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:23.148867 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:23.149344 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:23.149350 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:23.149353 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:23.149668 (+ 315us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:23.149835 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:23.150737 (+ 902us) server_negotiation.cc:299] Negotiation successful
0807 19:48:23.151021 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":425,"thread_start_us":252,"threads_started":1}
I20260807 19:48:23.152725 17301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:23.131777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43609 (local address 127.12.155.129:46473)
0807 19:48:23.132655 (+ 878us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:23.132710 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:23.134785 (+ 2075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:23.135780 (+ 995us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:23.135790 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:23.136432 (+ 642us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:23.137206 (+ 774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:23.137226 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.138525 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.138529 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:23.139895 (+ 1366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:23.139908 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.140779 (+ 871us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.140786 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:23.141059 (+ 273us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:23.141954 (+ 895us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:23.141981 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:23.144616 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:23.148073 (+ 3457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:23.148084 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:23.148112 (+ 28us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:23.148587 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:23.148995 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:23.149001 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:23.149005 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:23.149225 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:23.149803 (+ 578us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:23.149812 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:23.150316 (+ 504us) client_negotiation.cc:769] Sending connection context
0807 19:48:23.150630 (+ 314us) client_negotiation.cc:240] Negotiation successful
0807 19:48:23.151290 (+ 660us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":586,"thread_start_us":342,"threads_started":1}
I20260807 19:48:23.154760 17297 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43609
I20260807 19:48:23.155287 17297 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:23.156562 17297 heartbeater.cc:511] Master 127.12.155.190:43609 requested a full tablet report, sending...
I20260807 19:48:23.159866 16965 ts_manager.cc:194] Registered new tserver with Master: f7fdb0c13b2947229b960aa4301ebb1e (127.12.155.129:46101)
I20260807 19:48:23.162039 16965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:46473
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:23.207958 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43609
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:23.621845 17305 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:23.622325 17305 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:23.622445 17305 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:23.630686 17305 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:23.630913 17305 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:23.631119 17305 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:23.642740 17305 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:23.644547 17305 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:23.646322 17305 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:23.663085 17313 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:23.663033 17324 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:23.663190 17318 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:23.664029 17305 server_base.cc:1034] running on GCE node
I20260807 19:48:23.664868 17305 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:23.666183 17305 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:23.667464 17305 hybrid_clock.cc:648] HybridClock initialized: now 1786132103667387 us; error 92 us; skew 500 ppm
I20260807 19:48:23.667896 17305 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:23 dist-test-slave-2p8l krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:23.671954 17305 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:23.673744 17305 webserver.cc:460] Webserver started at http://127.12.155.130:36867/ using document root <none> and password file <none>
I20260807 19:48:23.674690 17305 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:23.674804 17305 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:23.675136 17305 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:23.678915 17305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "e265058b7c5c484ca2c09e3a2fb1cc3d"
format_stamp: "Formatted at 2026-08-07 19:48:23 on dist-test-slave-2p8l"
server_key: "735b723a0bb0a48c6dc37c2d8ca58cc8"
server_key_iv: "ad4f503f170021dc3a5be44c59290001"
server_key_version: "encryptionkey@0"
I20260807 19:48:23.679885 17305 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "e265058b7c5c484ca2c09e3a2fb1cc3d"
format_stamp: "Formatted at 2026-08-07 19:48:23 on dist-test-slave-2p8l"
server_key: "735b723a0bb0a48c6dc37c2d8ca58cc8"
server_key_iv: "ad4f503f170021dc3a5be44c59290001"
server_key_version: "encryptionkey@0"
I20260807 19:48:23.687022 17305 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.000s
I20260807 19:48:23.691556 17338 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:23.693325 17305 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260807 19:48:23.693572 17305 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "e265058b7c5c484ca2c09e3a2fb1cc3d"
format_stamp: "Formatted at 2026-08-07 19:48:23 on dist-test-slave-2p8l"
server_key: "735b723a0bb0a48c6dc37c2d8ca58cc8"
server_key_iv: "ad4f503f170021dc3a5be44c59290001"
server_key_version: "encryptionkey@0"
I20260807 19:48:23.693821 17305 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:23.723165 17305 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:23.728797 17305 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:23.729122 17305 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:23.730461 17305 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:23.732141 17305 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:23.732220 17305 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:23.732319 17305 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:23.732368 17305 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:23.776434 17305 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34465
I20260807 19:48:23.776495 17525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34465 every 8 connection(s)
I20260807 19:48:23.778211 17305 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:23.779696 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17305
I20260807 19:48:23.779951 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:23.780488 12910 external_mini_cluster.cc:1428] Setting key 59715810219a8ea647e95607a68fa6e2
Aug 07 19:48:23 dist-test-slave-2p8l krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132103, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:23.809095 17529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:23.782033 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:59417 (local address 127.12.155.190:43609)
0807 19:48:23.785194 (+ 3161us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:23.785203 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:23.785229 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:48:23.787362 (+ 2133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:23.787372 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:23.787502 (+ 130us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:23.787652 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:23.789844 (+ 2192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.791158 (+ 1314us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.793378 (+ 2220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.794270 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.794442 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:23.800071 (+ 5629us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:23.800078 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:23.800083 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:23.800135 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:23.803699 (+ 3564us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:23.805294 (+ 1595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:23.805306 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:23.805309 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:23.805561 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:23.806357 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:23.806362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:23.806365 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:23.806887 (+ 522us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:23.807189 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:23.808492 (+ 1303us) server_negotiation.cc:299] Negotiation successful
0807 19:48:23.808754 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3000,"thread_start_us":2798,"threads_started":1}
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
I20260807 19:48:23.811327 17531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:23.783017 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43609 (local address 127.12.155.130:59417)
0807 19:48:23.784398 (+ 1381us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:23.784517 (+ 119us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:23.786980 (+ 2463us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:23.788009 (+ 1029us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:23.788021 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:23.788733 (+ 712us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:23.789595 (+ 862us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:23.789619 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.791416 (+ 1797us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.791422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:23.793179 (+ 1757us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:23.793197 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:23.794582 (+ 1385us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:23.794588 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:23.794892 (+ 304us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:23.795976 (+ 1084us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:23.796009 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:23.799601 (+ 3592us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:23.804017 (+ 4416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:23.804035 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:23.804068 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:23.805044 (+ 976us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:23.805747 (+ 703us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:23.805754 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:23.805758 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:23.806195 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:23.807123 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:23.807137 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:23.807915 (+ 778us) client_negotiation.cc:769] Sending connection context
0807 19:48:23.808363 (+ 448us) client_negotiation.cc:240] Negotiation successful
0807 19:48:23.809211 (+ 848us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":503,"threads_started":1}
I20260807 19:48:23.813473 17526 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43609
I20260807 19:48:23.813905 17526 heartbeater.cc:464] Registering TS with master...
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
I20260807 19:48:23.815251 17526 heartbeater.cc:511] Master 127.12.155.190:43609 requested a full tablet report, sending...
I20260807 19:48:23.817618 16965 ts_manager.cc:194] Registered new tserver with Master: e265058b7c5c484ca2c09e3a2fb1cc3d (127.12.155.130:34465)
I20260807 19:48:23.818814 16965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:59417
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:23.851397 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43609
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35127
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:24.167311 17297 heartbeater.cc:503] Master 127.12.155.190:43609 was elected leader, sending a full tablet report...
W20260807 19:48:24.283808 17537 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:24.284209 17537 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:24.284410 17537 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:24.292585 17537 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:24.292742 17537 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:24.292964 17537 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:24.304968 17537 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35127
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43609
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:24.306978 17537 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:24.308822 17537 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:24.326085 17546 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:24.325944 17547 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:24.326622 17549 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:24.331823 17537 server_base.cc:1034] running on GCE node
I20260807 19:48:24.332806 17537 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:24.334312 17537 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:24.335569 17537 hybrid_clock.cc:648] HybridClock initialized: now 1786132104335485 us; error 75 us; skew 500 ppm
I20260807 19:48:24.335983 17537 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:24 dist-test-slave-2p8l krb5kdc[16906](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:24.344833 17537 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:24.347175 17537 webserver.cc:460] Webserver started at http://127.12.155.131:43519/ using document root <none> and password file <none>
I20260807 19:48:24.348202 17537 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:24.348380 17537 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:24.348817 17537 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:24.352710 17537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "3e8592bd27c5480fa851faac925cbd7a"
format_stamp: "Formatted at 2026-08-07 19:48:24 on dist-test-slave-2p8l"
server_key: "9b4c11783dce180c5bf14694dde8efa3"
server_key_iv: "1e0575bbae0e9823046acebd7b245794"
server_key_version: "encryptionkey@0"
I20260807 19:48:24.353830 17537 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "3e8592bd27c5480fa851faac925cbd7a"
format_stamp: "Formatted at 2026-08-07 19:48:24 on dist-test-slave-2p8l"
server_key: "9b4c11783dce180c5bf14694dde8efa3"
server_key_iv: "1e0575bbae0e9823046acebd7b245794"
server_key_version: "encryptionkey@0"
I20260807 19:48:24.360816 17537 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:24.365729 17558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:24.367584 17537 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:24.367803 17537 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "3e8592bd27c5480fa851faac925cbd7a"
format_stamp: "Formatted at 2026-08-07 19:48:24 on dist-test-slave-2p8l"
server_key: "9b4c11783dce180c5bf14694dde8efa3"
server_key_iv: "1e0575bbae0e9823046acebd7b245794"
server_key_version: "encryptionkey@0"
I20260807 19:48:24.368095 17537 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:24.401103 17537 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:24.407239 17537 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:24.407625 17537 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:24.409040 17537 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:24.410872 17537 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:24.411000 17537 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:24.411170 17537 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:24.411260 17537 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:24.452111 17537 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:42915
I20260807 19:48:24.452157 17748 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:42915 every 8 connection(s)
I20260807 19:48:24.453758 17537 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:24.455859 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17537
I20260807 19:48:24.456097 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNoKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:24.456809 12910 external_mini_cluster.cc:1428] Setting key b1663b5217e4322671db6cbef7c2c589
Aug 07 19:48:24 dist-test-slave-2p8l krb5kdc[16906](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132104, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:24.479213 17751 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:24.457198 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:59543 (local address 127.12.155.190:43609)
0807 19:48:24.459965 (+ 2767us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:24.459970 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:24.459990 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:48:24.461939 (+ 1949us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:24.461943 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:24.462024 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:24.462181 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:24.464083 (+ 1902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:24.465099 (+ 1016us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:24.467034 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:24.467506 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:24.467620 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:24.471975 (+ 4355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:24.471984 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:24.471993 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:24.472050 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:24.475792 (+ 3742us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:24.476678 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:24.476683 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:24.476686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:24.476829 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:24.477274 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:24.477277 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:24.477279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:24.477616 (+ 337us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:24.477746 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:24.478683 (+ 937us) server_negotiation.cc:299] Negotiation successful
0807 19:48:24.478892 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2626,"thread_start_us":2425,"threads_started":1}
I20260807 19:48:24.480595 17753 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:24.457904 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43609 (local address 127.12.155.131:59543)
0807 19:48:24.459212 (+ 1308us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:24.459289 (+ 77us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:24.461638 (+ 2349us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:24.462421 (+ 783us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:24.462431 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:24.463112 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:24.463874 (+ 762us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:24.463895 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:24.465279 (+ 1384us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:24.465284 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:24.466876 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:24.466891 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:24.467753 (+ 862us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:24.467758 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:24.468034 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:24.468826 (+ 792us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:24.468898 (+ 72us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:24.471642 (+ 2744us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:24.475936 (+ 4294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:24.475944 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:24.475963 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:24.476499 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:24.476928 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:24.476932 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:24.476934 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:24.477154 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:24.477773 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:24.477782 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:24.478276 (+ 494us) client_negotiation.cc:769] Sending connection context
0807 19:48:24.478579 (+ 303us) client_negotiation.cc:240] Negotiation successful
0807 19:48:24.479093 (+ 514us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":766,"thread_start_us":449,"threads_started":1}
I20260807 19:48:24.482429 17749 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43609
I20260807 19:48:24.482897 17749 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:24.484010 17749 heartbeater.cc:511] Master 127.12.155.190:43609 requested a full tablet report, sending...
I20260807 19:48:24.486135 16965 ts_manager.cc:194] Registered new tserver with Master: 3e8592bd27c5480fa851faac925cbd7a (127.12.155.131:42915)
I20260807 19:48:24.487218 16965 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:59543
I20260807 19:48:24.487515 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 19:48:24.550508 17751 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:24.546512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59978 (local address 127.12.155.190:43609)
0807 19:48:24.546824 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:24.546833 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:24.547227 (+ 394us) server_negotiation.cc:407] Connection header received
0807 19:48:24.547522 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:24.547531 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:24.547674 (+ 143us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:24.547845 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:24.550092 (+ 2247us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:59978: BlockingRecv error: recv got EOF from 127.0.0.1:59978 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 19:48:24.555455 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17070
W20260807 19:48:24.559661 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17070: Not authorized: Client connection negotiation failed: client connection to 127.12.155.129:46101: server requires authentication, but client does not have Kerberos credentials available
I20260807 19:48:24.560022 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17070
I20260807 19:48:24.595032 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17305
W20260807 19:48:24.598673 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17305: Not authorized: Client connection negotiation failed: client connection to 127.12.155.130:34465: server requires authentication, but client does not have Kerberos credentials available
I20260807 19:48:24.598944 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17305
I20260807 19:48:24.629776 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17537
W20260807 19:48:24.634040 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17537: Not authorized: Client connection negotiation failed: client connection to 127.12.155.131:42915: server requires authentication, but client does not have Kerberos credentials available
I20260807 19:48:24.634332 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17537
I20260807 19:48:24.676595 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16922
I20260807 19:48:24.678544 17017 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:24.807670 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16922
2026-08-07T19:48:24Z chronyd exiting
[ OK ] SecurityITest.TestNoKerberosCredentials (4697 ms)
[ RUN ] SecurityITest.SaslPlainFallback
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:24 dist-test-slave-2p8l krb5kdc[17780](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:24 dist-test-slave-2p8l krb5kdc[17780](info): set up 2 sockets
Aug 07 19:48:24 dist-test-slave-2p8l krb5kdc[17780](info): commencing operation
krb5kdc: starting...
W20260807 19:48:26.237690 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.360s user 0.000s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:26 dist-test-slave-2p8l krb5kdc[17780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:26.506903 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36505
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43523
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:36505
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc-authentication=optional
--user-acl=* with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:26.919332 17805 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:26.919796 17805 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:26.920006 17805 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:26.928735 17805 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:26.928925 17805 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:26.929034 17805 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:26.929145 17805 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:26.929281 17805 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:26.941368 17805 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43523
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:36505
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36505
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:26.943356 17805 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:26.945199 17805 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:26.960156 17821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:26.960156 17816 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:26.960409 17826 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:26.961193 17805 server_base.cc:1034] running on GCE node
I20260807 19:48:26.962369 17805 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:26.964303 17805 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:26.965615 17805 hybrid_clock.cc:648] HybridClock initialized: now 1786132106965553 us; error 76 us; skew 500 ppm
I20260807 19:48:26.966120 17805 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:26 dist-test-slave-2p8l krb5kdc[17780](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132106, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:26.969925 17805 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:26.971807 17805 webserver.cc:460] Webserver started at http://127.12.155.190:36039/ using document root <none> and password file <none>
I20260807 19:48:26.972693 17805 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:26.972854 17805 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:26.973284 17805 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:26.977123 17805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "d703ff3ca13d4334b41084dbe5cc2232"
format_stamp: "Formatted at 2026-08-07 19:48:26 on dist-test-slave-2p8l"
server_key: "89f063c327be5800ef9530dac5495863"
server_key_iv: "23fe38f953ab5593aff18e9d03ab3ed8"
server_key_version: "encryptionkey@0"
I20260807 19:48:26.978165 17805 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "d703ff3ca13d4334b41084dbe5cc2232"
format_stamp: "Formatted at 2026-08-07 19:48:26 on dist-test-slave-2p8l"
server_key: "89f063c327be5800ef9530dac5495863"
server_key_iv: "23fe38f953ab5593aff18e9d03ab3ed8"
server_key_version: "encryptionkey@0"
I20260807 19:48:26.984611 17805 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:26.989027 17847 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:26.990959 17805 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:26.991210 17805 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "d703ff3ca13d4334b41084dbe5cc2232"
format_stamp: "Formatted at 2026-08-07 19:48:26 on dist-test-slave-2p8l"
server_key: "89f063c327be5800ef9530dac5495863"
server_key_iv: "23fe38f953ab5593aff18e9d03ab3ed8"
server_key_version: "encryptionkey@0"
I20260807 19:48:26.991478 17805 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:27.013765 17805 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:27.018980 17805 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:27.019345 17805 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:27.041118 17805 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:36505
I20260807 19:48:27.041137 17930 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:36505 every 8 connection(s)
I20260807 19:48:27.042950 17805 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:27.047976 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17805
I20260807 19:48:27.048133 17931 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:27.048296 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.SaslPlainFallback.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:27.049475 12910 external_mini_cluster.cc:1428] Setting key a3da49e90d94722ac5bf1af0ef637249
I20260807 19:48:27.066207 17931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232: Bootstrap starting.
Aug 07 19:48:27 dist-test-slave-2p8l krb5kdc[17780](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132106, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:27.071007 17931 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:27.072878 17931 log.cc:824] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:27.077371 17931 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232: No bootstrap required, opened a new log
I20260807 19:48:27.081096 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:27.052186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41872 (local address 127.12.155.190:36505)
0807 19:48:27.053777 (+ 1591us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:27.053799 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:27.053882 (+ 83us) server_negotiation.cc:407] Connection header received
0807 19:48:27.058390 (+ 4508us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:27.058429 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:27.059048 (+ 619us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:27.059588 (+ 540us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:27.061489 (+ 1901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:27.063163 (+ 1674us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:27.064662 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:27.065450 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:27.065677 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:27.071004 (+ 5327us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:27.071019 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:27.071047 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:27.071119 (+ 72us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:27.075842 (+ 4723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:27.076778 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:27.076789 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:27.076799 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:27.077078 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:27.077569 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:27.077574 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:27.077576 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:27.078380 (+ 804us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:27.078763 (+ 383us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:27.079271 (+ 508us) server_negotiation.cc:299] Negotiation successful
0807 19:48:27.079802 (+ 531us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1202,"thread_start_us":622,"threads_started":1}
I20260807 19:48:27.086313 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:48:27.087628 17931 raft_consensus.cc:348] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d703ff3ca13d4334b41084dbe5cc2232" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36505 } }
I20260807 19:48:27.088089 17931 raft_consensus.cc:374] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:27.088231 17931 raft_consensus.cc:729] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d703ff3ca13d4334b41084dbe5cc2232, State: Initialized, Role: FOLLOWER
I20260807 19:48:27.088920 17931 consensus_queue.cc:260] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d703ff3ca13d4334b41084dbe5cc2232" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36505 } }
I20260807 19:48:27.089191 17931 raft_consensus.cc:388] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:27.089346 17931 raft_consensus.cc:482] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:27.089570 17931 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:27.092316 17931 raft_consensus.cc:504] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d703ff3ca13d4334b41084dbe5cc2232" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36505 } }
I20260807 19:48:27.092963 17931 leader_election.cc:302] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d703ff3ca13d4334b41084dbe5cc2232; no voters:
I20260807 19:48:27.093801 17931 leader_election.cc:288] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:27.093992 17940 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:27.095543 17940 raft_consensus.cc:686] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [term 1 LEADER]: Becoming Leader. State: Replica: d703ff3ca13d4334b41084dbe5cc2232, State: Running, Role: LEADER
I20260807 19:48:27.096213 17940 consensus_queue.cc:237] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d703ff3ca13d4334b41084dbe5cc2232" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36505 } }
I20260807 19:48:27.097154 17931 sys_catalog.cc:564] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:27.099889 17943 sys_catalog.cc:455] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d703ff3ca13d4334b41084dbe5cc2232. Latest consensus state: current_term: 1 leader_uuid: "d703ff3ca13d4334b41084dbe5cc2232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d703ff3ca13d4334b41084dbe5cc2232" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36505 } } }
I20260807 19:48:27.100404 17943 sys_catalog.cc:458] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:27.099895 17942 sys_catalog.cc:455] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d703ff3ca13d4334b41084dbe5cc2232" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d703ff3ca13d4334b41084dbe5cc2232" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36505 } } }
I20260807 19:48:27.101070 17942 sys_catalog.cc:458] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:27.115319 17952 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:27.122668 17952 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:27.137187 17952 catalog_manager.cc:1347] Generated new cluster ID: 7a1259cc062048e5a1d7543efb7b53a0
I20260807 19:48:27.137377 17952 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:27.151068 17952 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:27.153817 17952 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:27.166923 17952 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d703ff3ca13d4334b41084dbe5cc2232: Generated new TSK 0
I20260807 19:48:27.168391 17952 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:48:27.168655 17938 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:27.157448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41886 (local address 127.12.155.190:36505)
0807 19:48:27.157651 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:27.157659 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:27.157751 (+ 92us) server_negotiation.cc:407] Connection header received
0807 19:48:27.158123 (+ 372us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:27.158130 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:27.158238 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:27.158385 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:27.159906 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:27.161169 (+ 1263us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:27.163315 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:27.164087 (+ 772us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:27.164226 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:27.166593 (+ 2367us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:27.166600 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:27.166607 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:27.167547 (+ 940us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:27.167637 (+ 90us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:27.167665 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:27.167824 (+ 159us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:27.167990 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 19:48:27.168121 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":2,"server-negotiator.queue_time_us":72}
I20260807 19:48:27.181309 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17805
I20260807 19:48:27.183640 17923 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:27.283057 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17805
2026-08-07T19:48:27Z chronyd exiting
[ OK ] SecurityITest.SaslPlainFallback (2464 ms)
[ RUN ] SecurityITest.TestUnauthorizedClientKerberosCredentials
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:27 dist-test-slave-2p8l krb5kdc[17990](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:27 dist-test-slave-2p8l krb5kdc[17990](info): set up 2 sockets
Aug 07 19:48:27 dist-test-slave-2p8l krb5kdc[17990](info): commencing operation
krb5kdc: starting...
W20260807 19:48:28.682721 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.342s user 0.005s sys 0.028s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:28 dist-test-slave-2p8l krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:28.970549 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36343
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:36343
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:29.380548 18019 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:29.380967 18019 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:29.381160 18019 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:29.388938 18019 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:29.389109 18019 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:29.389225 18019 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:29.389340 18019 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:29.389441 18019 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:29.401059 18019 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:36343
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36343
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:29.402973 18019 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:29.404703 18019 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:29.419085 18028 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:29.419029 18032 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:29.419152 18030 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:29.420370 18019 server_base.cc:1034] running on GCE node
I20260807 19:48:29.421353 18019 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:29.423290 18019 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:29.424530 18019 hybrid_clock.cc:648] HybridClock initialized: now 1786132109424474 us; error 38 us; skew 500 ppm
I20260807 19:48:29.424938 18019 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:29 dist-test-slave-2p8l krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132109, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:29.428793 18019 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:29.430748 18019 webserver.cc:460] Webserver started at http://127.12.155.190:38551/ using document root <none> and password file <none>
I20260807 19:48:29.431617 18019 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:29.431764 18019 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:29.432159 18019 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:29.435845 18019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "5164ded87c6d4535a7a43ef9102be798"
format_stamp: "Formatted at 2026-08-07 19:48:29 on dist-test-slave-2p8l"
server_key: "376a92f7a66d7d1eeafaf129ed8c0345"
server_key_iv: "6e6fba8171ba0ba725b1c328a4bb60d6"
server_key_version: "encryptionkey@0"
I20260807 19:48:29.436722 18019 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "5164ded87c6d4535a7a43ef9102be798"
format_stamp: "Formatted at 2026-08-07 19:48:29 on dist-test-slave-2p8l"
server_key: "376a92f7a66d7d1eeafaf129ed8c0345"
server_key_iv: "6e6fba8171ba0ba725b1c328a4bb60d6"
server_key_version: "encryptionkey@0"
I20260807 19:48:29.443061 18019 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:48:29.447335 18043 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:29.449090 18019 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:48:29.449303 18019 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "5164ded87c6d4535a7a43ef9102be798"
format_stamp: "Formatted at 2026-08-07 19:48:29 on dist-test-slave-2p8l"
server_key: "376a92f7a66d7d1eeafaf129ed8c0345"
server_key_iv: "6e6fba8171ba0ba725b1c328a4bb60d6"
server_key_version: "encryptionkey@0"
I20260807 19:48:29.449532 18019 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:29.480513 18019 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:29.485728 18019 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:29.486158 18019 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:29.509244 18019 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:36343
I20260807 19:48:29.509277 18128 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:36343 every 8 connection(s)
I20260807 19:48:29.511092 18019 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:29.511759 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18019
I20260807 19:48:29.512074 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:29.513057 12910 external_mini_cluster.cc:1428] Setting key 1d40b8dd8c475734c0d0db03c7a6296f
I20260807 19:48:29.516889 18129 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:48:29 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132108, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:29.529816 18129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798: Bootstrap starting.
I20260807 19:48:29.534204 18129 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:29.535538 18129 log.cc:824] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:29.539270 18139 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:29.515741 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36352 (local address 127.12.155.190:36343)
0807 19:48:29.516676 (+ 935us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:29.516691 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:29.516742 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:48:29.518734 (+ 1992us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:29.518763 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:29.519216 (+ 453us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:29.519684 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:29.521410 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:29.522969 (+ 1559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:29.524325 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:29.525075 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:29.525303 (+ 228us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:29.530306 (+ 5003us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:29.530316 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:29.530335 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:29.530383 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:29.533847 (+ 3464us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:29.534985 (+ 1138us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:29.535002 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:29.535012 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:29.535225 (+ 213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:29.535754 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:29.535759 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:29.535762 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:29.536512 (+ 750us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:29.536889 (+ 377us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:29.537424 (+ 535us) server_negotiation.cc:299] Negotiation successful
0807 19:48:29.537948 (+ 524us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":692,"thread_start_us":401,"threads_started":1}
I20260807 19:48:29.539577 18129 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798: No bootstrap required, opened a new log
I20260807 19:48:29.549137 18129 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5164ded87c6d4535a7a43ef9102be798" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36343 } }
I20260807 19:48:29.549628 18129 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:29.549750 18129 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5164ded87c6d4535a7a43ef9102be798, State: Initialized, Role: FOLLOWER
I20260807 19:48:29.550534 18129 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5164ded87c6d4535a7a43ef9102be798" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36343 } }
I20260807 19:48:29.550823 18129 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:29.550990 18129 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:29.551189 18129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:29.554087 18129 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5164ded87c6d4535a7a43ef9102be798" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36343 } }
I20260807 19:48:29.554807 18129 leader_election.cc:302] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5164ded87c6d4535a7a43ef9102be798; no voters:
I20260807 19:48:29.555598 18129 leader_election.cc:288] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:29.555821 18141 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:29.556576 18141 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [term 1 LEADER]: Becoming Leader. State: Replica: 5164ded87c6d4535a7a43ef9102be798, State: Running, Role: LEADER
I20260807 19:48:29.557286 18141 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5164ded87c6d4535a7a43ef9102be798" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36343 } }
I20260807 19:48:29.558393 18129 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:29.571167 18144 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5164ded87c6d4535a7a43ef9102be798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5164ded87c6d4535a7a43ef9102be798" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36343 } } }
I20260807 19:48:29.571863 18145 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5164ded87c6d4535a7a43ef9102be798. Latest consensus state: current_term: 1 leader_uuid: "5164ded87c6d4535a7a43ef9102be798" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5164ded87c6d4535a7a43ef9102be798" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36343 } } }
I20260807 19:48:29.572134 18145 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:29.572017 18144 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:29.573225 18158 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:29.580555 18158 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:29.592731 18158 catalog_manager.cc:1347] Generated new cluster ID: 75f478d6e7754873b8eedb23f4782b4b
I20260807 19:48:29.592904 18158 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:29.606455 18158 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:29.608069 18158 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:29.614887 18158 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5164ded87c6d4535a7a43ef9102be798: Generated new TSK 0
I20260807 19:48:29.615976 18158 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:29.680316 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36343
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:30.097939 18180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:30.098393 18180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:30.098558 18180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:30.106664 18180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:30.106801 18180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:30.106990 18180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:30.118541 18180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:30.120429 18180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:30.122205 18180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:30.138357 18192 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:30.138295 18193 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:30.138314 18195 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:30.139390 18180 server_base.cc:1034] running on GCE node
I20260807 19:48:30.140311 18180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:30.141594 18180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:30.142839 18180 hybrid_clock.cc:648] HybridClock initialized: now 1786132110142783 us; error 57 us; skew 500 ppm
I20260807 19:48:30.143256 18180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:30 dist-test-slave-2p8l krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132110, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:30.150908 18180 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:30.152805 18180 webserver.cc:460] Webserver started at http://127.12.155.129:44947/ using document root <none> and password file <none>
I20260807 19:48:30.153775 18180 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:30.153946 18180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:30.154421 18180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:30.158000 18180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "883b1038a57741199f6e8c78a0de72f6"
format_stamp: "Formatted at 2026-08-07 19:48:30 on dist-test-slave-2p8l"
server_key: "f165f0329bc62899bf21c87e46ed0aa5"
server_key_iv: "bde39a55c26af57be586ff6f2467e09b"
server_key_version: "encryptionkey@0"
I20260807 19:48:30.158995 18180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "883b1038a57741199f6e8c78a0de72f6"
format_stamp: "Formatted at 2026-08-07 19:48:30 on dist-test-slave-2p8l"
server_key: "f165f0329bc62899bf21c87e46ed0aa5"
server_key_iv: "bde39a55c26af57be586ff6f2467e09b"
server_key_version: "encryptionkey@0"
I20260807 19:48:30.165133 18180 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:48:30.169121 18212 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:30.170902 18180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:30.171164 18180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "883b1038a57741199f6e8c78a0de72f6"
format_stamp: "Formatted at 2026-08-07 19:48:30 on dist-test-slave-2p8l"
server_key: "f165f0329bc62899bf21c87e46ed0aa5"
server_key_iv: "bde39a55c26af57be586ff6f2467e09b"
server_key_version: "encryptionkey@0"
I20260807 19:48:30.171433 18180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:30.196348 18180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:30.201689 18180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:30.202137 18180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:30.203437 18180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:30.205142 18180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:30.205229 18180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:30.205368 18180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:30.205453 18180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:30.245208 18180 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:38817
I20260807 19:48:30.245244 18397 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:38817 every 8 connection(s)
I20260807 19:48:30.246930 18180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:30.252950 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18180
I20260807 19:48:30.253202 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:30.254097 12910 external_mini_cluster.cc:1428] Setting key db4fda18b1ec02b3950be2546cc7208f
Aug 07 19:48:30 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132110, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:30.274924 18407 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:30.250127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:56741 (local address 127.12.155.190:36343)
0807 19:48:30.250718 (+ 591us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:30.250724 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:30.251690 (+ 966us) server_negotiation.cc:407] Connection header received
0807 19:48:30.254147 (+ 2457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:30.254157 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:30.254283 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:30.254424 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:30.256280 (+ 1856us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.257385 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.259412 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.260242 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.260400 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:30.266257 (+ 5857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:30.266267 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:30.266275 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:30.266330 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:30.270482 (+ 4152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:30.271365 (+ 883us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:30.271375 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:30.271382 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:30.271567 (+ 185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:30.272151 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:30.272159 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:30.272166 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:30.272715 (+ 549us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:30.272912 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:30.273928 (+ 1016us) server_negotiation.cc:299] Negotiation successful
0807 19:48:30.274310 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":315,"threads_started":1}
I20260807 19:48:30.275913 18408 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:30.250676 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36343 (local address 127.12.155.129:56741)
0807 19:48:30.251489 (+ 813us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:30.251542 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:30.253718 (+ 2176us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:30.254648 (+ 930us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:30.254657 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:30.255393 (+ 736us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:30.256109 (+ 716us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:30.256128 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.257607 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.257612 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:30.259221 (+ 1609us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:30.259236 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.260616 (+ 1380us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.260627 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:30.261204 (+ 577us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:30.262479 (+ 1275us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:30.262508 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:30.265910 (+ 3402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:30.270660 (+ 4750us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:30.270669 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:30.270688 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:30.271210 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:30.271686 (+ 476us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:30.271689 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:30.271691 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:30.271991 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:30.272860 (+ 869us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:30.272868 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:30.273378 (+ 510us) client_negotiation.cc:769] Sending connection context
0807 19:48:30.273735 (+ 357us) client_negotiation.cc:240] Negotiation successful
0807 19:48:30.274365 (+ 630us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":544,"thread_start_us":313,"threads_started":1}
I20260807 19:48:30.278170 18398 heartbeater.cc:347] Connected to a master server at 127.12.155.190:36343
I20260807 19:48:30.278568 18398 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:30.279547 18398 heartbeater.cc:511] Master 127.12.155.190:36343 requested a full tablet report, sending...
I20260807 19:48:30.282519 18075 ts_manager.cc:194] Registered new tserver with Master: 883b1038a57741199f6e8c78a0de72f6 (127.12.155.129:38817)
I20260807 19:48:30.284322 18075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:56741
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:30.322160 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36343
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:30.754519 18415 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:30.755012 18415 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:30.755211 18415 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:30.763646 18415 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:30.763840 18415 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:30.764042 18415 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:30.775588 18415 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:30.777529 18415 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:30.779404 18415 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:30.796657 18428 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:30.796854 18432 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:30.797498 18429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:30.798648 18415 server_base.cc:1034] running on GCE node
I20260807 19:48:30.799553 18415 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:30.800959 18415 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:30.802503 18415 hybrid_clock.cc:648] HybridClock initialized: now 1786132110802412 us; error 68 us; skew 500 ppm
I20260807 19:48:30.802971 18415 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:30 dist-test-slave-2p8l krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132110, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:30.808089 18415 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:30.810182 18415 webserver.cc:460] Webserver started at http://127.12.155.130:38965/ using document root <none> and password file <none>
I20260807 19:48:30.811161 18415 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:30.811290 18415 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:30.811640 18415 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:30.815748 18415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "8a94d632cd244a5da0decea40c433885"
format_stamp: "Formatted at 2026-08-07 19:48:30 on dist-test-slave-2p8l"
server_key: "8556a285b15d07c58c60f0a16a49cbaa"
server_key_iv: "620a6e2d90ea357fb5f210e76427d32b"
server_key_version: "encryptionkey@0"
I20260807 19:48:30.816694 18415 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "8a94d632cd244a5da0decea40c433885"
format_stamp: "Formatted at 2026-08-07 19:48:30 on dist-test-slave-2p8l"
server_key: "8556a285b15d07c58c60f0a16a49cbaa"
server_key_iv: "620a6e2d90ea357fb5f210e76427d32b"
server_key_version: "encryptionkey@0"
I20260807 19:48:30.823566 18415 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260807 19:48:30.828076 18443 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:30.829900 18415 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:48:30.830152 18415 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "8a94d632cd244a5da0decea40c433885"
format_stamp: "Formatted at 2026-08-07 19:48:30 on dist-test-slave-2p8l"
server_key: "8556a285b15d07c58c60f0a16a49cbaa"
server_key_iv: "620a6e2d90ea357fb5f210e76427d32b"
server_key_version: "encryptionkey@0"
I20260807 19:48:30.830376 18415 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:30.863570 18415 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:30.869246 18415 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:30.869680 18415 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:30.871059 18415 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:30.873415 18415 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:30.873557 18415 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:30.873740 18415 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:30.873833 18415 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:30.917443 18415 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:42995
I20260807 19:48:30.917481 18636 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:42995 every 8 connection(s)
I20260807 19:48:30.919240 18415 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:30.925416 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18415
I20260807 19:48:30.925664 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:30.926295 12910 external_mini_cluster.cc:1428] Setting key af7c88af9b772defa64ada8b4063e180
Aug 07 19:48:30 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132110, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:30.945276 18640 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:30.922862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:60653 (local address 127.12.155.190:36343)
0807 19:48:30.923474 (+ 612us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:30.923481 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:30.924751 (+ 1270us) server_negotiation.cc:407] Connection header received
0807 19:48:30.927422 (+ 2671us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:30.927429 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:30.927558 (+ 129us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:30.927710 (+ 152us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:30.929710 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.930644 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.932572 (+ 1928us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.933094 (+ 522us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.933257 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:30.938282 (+ 5025us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:30.938288 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:30.938292 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:30.938348 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:30.941466 (+ 3118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:30.942414 (+ 948us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:30.942420 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:30.942424 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:30.942570 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:30.943086 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:30.943090 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:30.943093 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:30.943440 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:30.943614 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:30.944552 (+ 938us) server_negotiation.cc:299] Negotiation successful
0807 19:48:30.944834 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":290,"threads_started":1}
I20260807 19:48:30.946758 18645 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:30.923581 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36343 (local address 127.12.155.130:60653)
0807 19:48:30.924517 (+ 936us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:30.924577 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:30.927038 (+ 2461us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:30.928036 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:30.928048 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:30.928722 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:30.929506 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:30.929525 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.930837 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.930842 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:30.932398 (+ 1556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:30.932412 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:30.933405 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:30.933414 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:30.933717 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:30.934805 (+ 1088us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:30.934938 (+ 133us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:30.937923 (+ 2985us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:30.941645 (+ 3722us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:30.941657 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:30.941688 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:30.942276 (+ 588us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:30.942696 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:30.942702 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:30.942705 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:30.942946 (+ 241us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:30.943583 (+ 637us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:30.943593 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:30.944086 (+ 493us) client_negotiation.cc:769] Sending connection context
0807 19:48:30.944410 (+ 324us) client_negotiation.cc:240] Negotiation successful
0807 19:48:30.945142 (+ 732us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":604,"thread_start_us":341,"threads_started":1}
I20260807 19:48:30.948817 18637 heartbeater.cc:347] Connected to a master server at 127.12.155.190:36343
I20260807 19:48:30.949237 18637 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:30.950307 18637 heartbeater.cc:511] Master 127.12.155.190:36343 requested a full tablet report, sending...
I20260807 19:48:30.952239 18075 ts_manager.cc:194] Registered new tserver with Master: 8a94d632cd244a5da0decea40c433885 (127.12.155.130:42995)
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
I20260807 19:48:30.953824 18075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:60653
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:30.990550 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36343
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32827
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:31.288655 18398 heartbeater.cc:503] Master 127.12.155.190:36343 was elected leader, sending a full tablet report...
W20260807 19:48:31.406219 18651 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:31.406597 18651 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:31.406709 18651 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:31.414759 18651 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:31.414914 18651 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:31.415045 18651 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:31.426591 18651 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32827
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36343
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:31.428418 18651 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:31.430249 18651 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:31.446633 18657 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:31.446609 18658 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:31.447266 18663 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:31.447613 18651 server_base.cc:1034] running on GCE node
I20260807 19:48:31.448421 18651 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:31.449656 18651 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:31.450949 18651 hybrid_clock.cc:648] HybridClock initialized: now 1786132111450875 us; error 61 us; skew 500 ppm
I20260807 19:48:31.451421 18651 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:31.455525 18651 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:31.457291 18651 webserver.cc:460] Webserver started at http://127.12.155.131:41267/ using document root <none> and password file <none>
I20260807 19:48:31.458235 18651 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:31.458398 18651 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:31.458863 18651 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:31.462714 18651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "b516c048503f4149a62611f3aff260e1"
format_stamp: "Formatted at 2026-08-07 19:48:31 on dist-test-slave-2p8l"
server_key: "0d7c97c227863e9a0e27dd52e7ab5dc4"
server_key_iv: "d4becc6f11dc528fd681c2c8031e8e51"
server_key_version: "encryptionkey@0"
I20260807 19:48:31.463634 18651 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "b516c048503f4149a62611f3aff260e1"
format_stamp: "Formatted at 2026-08-07 19:48:31 on dist-test-slave-2p8l"
server_key: "0d7c97c227863e9a0e27dd52e7ab5dc4"
server_key_iv: "d4becc6f11dc528fd681c2c8031e8e51"
server_key_version: "encryptionkey@0"
I20260807 19:48:31.470048 18651 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:48:31.474603 18671 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:31.476634 18651 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.004s
I20260807 19:48:31.476871 18651 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "b516c048503f4149a62611f3aff260e1"
format_stamp: "Formatted at 2026-08-07 19:48:31 on dist-test-slave-2p8l"
server_key: "0d7c97c227863e9a0e27dd52e7ab5dc4"
server_key_iv: "d4becc6f11dc528fd681c2c8031e8e51"
server_key_version: "encryptionkey@0"
I20260807 19:48:31.477190 18651 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:31.505383 18651 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:31.510950 18651 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:31.511345 18651 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:31.512669 18651 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:31.514473 18651 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:31.514585 18651 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:31.514756 18651 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:31.514850 18651 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:31.554607 18651 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:37961
I20260807 19:48:31.554661 18886 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:37961 every 8 connection(s)
I20260807 19:48:31.556345 18651 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:31.563334 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18651
I20260807 19:48:31.563586 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestUnauthorizedClientKerberosCredentials.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:31.564229 12910 external_mini_cluster.cc:1428] Setting key 2756bde80dac14b0240df778cd8177ee
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:31.583047 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:31.560337 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:48143 (local address 127.12.155.190:36343)
0807 19:48:31.560900 (+ 563us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:31.560905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:31.562298 (+ 1393us) server_negotiation.cc:407] Connection header received
0807 19:48:31.564677 (+ 2379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:31.564686 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:31.564804 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:31.564966 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:31.567315 (+ 2349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.568501 (+ 1186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.570275 (+ 1774us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.570688 (+ 413us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.570809 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:31.575164 (+ 4355us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:31.575171 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:31.575175 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:31.575226 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:31.578904 (+ 3678us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.579958 (+ 1054us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.579964 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.579969 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.580195 (+ 226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.580779 (+ 584us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.580785 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.580789 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.581193 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:31.581382 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:31.582391 (+ 1009us) server_negotiation.cc:299] Negotiation successful
0807 19:48:31.582661 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":261,"threads_started":1}
I20260807 19:48:31.584350 18892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:31.561151 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36343 (local address 127.12.155.131:48143)
0807 19:48:31.562008 (+ 857us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:31.562151 (+ 143us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:31.564261 (+ 2110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:31.565292 (+ 1031us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:31.565303 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:31.566232 (+ 929us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:31.567115 (+ 883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:31.567150 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.568660 (+ 1510us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.568664 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:31.570129 (+ 1465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:31.570144 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.570911 (+ 767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.570916 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:31.571142 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:31.572029 (+ 887us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:31.572057 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:31.574878 (+ 2821us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:31.579126 (+ 4248us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:31.579136 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:31.579158 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:31.579800 (+ 642us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:31.580326 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:31.580330 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:31.580332 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:31.580616 (+ 284us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:31.581344 (+ 728us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:31.581355 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:31.581918 (+ 563us) client_negotiation.cc:769] Sending connection context
0807 19:48:31.582240 (+ 322us) client_negotiation.cc:240] Negotiation successful
0807 19:48:31.582896 (+ 656us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":331,"threads_started":1}
I20260807 19:48:31.586112 18887 heartbeater.cc:347] Connected to a master server at 127.12.155.190:36343
I20260807 19:48:31.586530 18887 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:31.587482 18887 heartbeater.cc:511] Master 127.12.155.190:36343 requested a full tablet report, sending...
I20260807 19:48:31.589337 18075 ts_manager.cc:194] Registered new tserver with Master: b516c048503f4149a62611f3aff260e1 (127.12.155.131:37961)
I20260807 19:48:31.590417 18075 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:48143
I20260807 19:48:31.594734 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for joe-interloper@KRBTEST.COM:
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:31.666888 18890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:31.649039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36366 (local address 127.12.155.190:36343)
0807 19:48:31.649348 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:31.649355 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:31.649693 (+ 338us) server_negotiation.cc:407] Connection header received
0807 19:48:31.649976 (+ 283us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:31.649981 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:31.650167 (+ 186us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:31.650267 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:31.652248 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.653140 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.654653 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.655216 (+ 563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.655323 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:31.660201 (+ 4878us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:31.660208 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:31.660212 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:31.660263 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:31.663597 (+ 3334us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.664394 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.664401 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.664405 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.664589 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.665031 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.665037 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.665040 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.665501 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:31.665803 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:31.666202 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 19:48:31.666504 (+ 302us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":106}
W20260807 19:48:31.667613 18075 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.ConnectToMaster from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36366
I20260807 19:48:31.670699 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18180
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:31.693194 18910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:31.672151 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41360 (local address 127.12.155.129:38817)
0807 19:48:31.673045 (+ 894us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:31.673054 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:31.673088 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:48:31.673169 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:31.673178 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:31.673535 (+ 357us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:31.673778 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:31.675303 (+ 1525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.676578 (+ 1275us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.678342 (+ 1764us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.679068 (+ 726us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.679190 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:31.685017 (+ 5827us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:31.685040 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:31.685065 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:31.685126 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:31.689153 (+ 4027us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.690447 (+ 1294us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.690458 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.690461 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.690636 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.691142 (+ 506us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.691146 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.691148 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.691626 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:31.692007 (+ 381us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:31.692335 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 19:48:31.692621 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":719,"thread_start_us":481,"threads_started":1}
W20260807 19:48:31.695268 18391 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:41360
W20260807 19:48:31.696909 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18180: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:31.697204 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18180
I20260807 19:48:31.730693 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18415
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:31.751582 18912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:31.732103 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55694 (local address 127.12.155.130:42995)
0807 19:48:31.732841 (+ 738us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:31.732850 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:31.732883 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:48:31.732967 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:31.732975 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:31.733262 (+ 287us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:31.733429 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:31.735163 (+ 1734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.736566 (+ 1403us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.738180 (+ 1614us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.738889 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.739025 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:31.744101 (+ 5076us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:31.744119 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:31.744140 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:31.744190 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:31.747826 (+ 3636us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.748743 (+ 917us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.748753 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.748755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.748923 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.749410 (+ 487us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.749415 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.749418 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.749900 (+ 482us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:31.750372 (+ 472us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:31.750747 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 19:48:31.751108 (+ 361us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":368,"threads_started":1}
W20260807 19:48:31.753274 18627 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:55694
W20260807 19:48:31.755103 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18415: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:31.755399 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18415
I20260807 19:48:31.796761 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18651
Aug 07 19:48:31 dist-test-slave-2p8l krb5kdc[17990](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132111, etypes {rep=17 tkt=17 ses=17}, joe-interloper@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:31.820603 18914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:31.798512 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:36000 (local address 127.12.155.131:37961)
0807 19:48:31.799424 (+ 912us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:31.799433 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:31.799472 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:48:31.799557 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:31.799565 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:31.799875 (+ 310us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:31.800169 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:31.801922 (+ 1753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.803559 (+ 1637us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.805139 (+ 1580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:31.805857 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:31.806077 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:31.813033 (+ 6956us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:31.813051 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:31.813072 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:31.813130 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:31.816906 (+ 3776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.817745 (+ 839us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.817754 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.817757 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.817968 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:31.818573 (+ 605us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:31.818579 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:31.818583 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:31.819278 (+ 695us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:31.819602 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:31.819982 (+ 380us) server_negotiation.cc:299] Negotiation successful
0807 19:48:31.820255 (+ 273us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":505,"threads_started":1}
W20260807 19:48:31.822582 18873 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='joe-interloper', principal='joe-interloper@KRBTEST.COM'} at 127.0.0.1:36000
W20260807 19:48:31.824337 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18651: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:48:31.824652 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18651
I20260807 19:48:31.859782 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18019
I20260807 19:48:31.861539 18123 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:31.983420 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18019
2026-08-07T19:48:32Z chronyd exiting
[ OK ] SecurityITest.TestUnauthorizedClientKerberosCredentials (4703 ms)
[ RUN ] SecurityITest.TestAuthorizedSuperuser
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:32 dist-test-slave-2p8l krb5kdc[18918](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:32 dist-test-slave-2p8l krb5kdc[18918](info): set up 2 sockets
Aug 07 19:48:32 dist-test-slave-2p8l krb5kdc[18918](info): commencing operation
krb5kdc: starting...
W20260807 19:48:33.441897 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.397s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:33 dist-test-slave-2p8l krb5kdc[18918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:33.726707 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45291
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:45291
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:34.150395 18936 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:34.150882 18936 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:34.151082 18936 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:34.159119 18936 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:34.159329 18936 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:34.159462 18936 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:34.159587 18936 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:34.159689 18936 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:34.171042 18936 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:45291
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45291
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:34.173034 18936 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:34.174962 18936 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:34.190582 18946 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:34.190490 18953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:34.190539 18947 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:34.191509 18936 server_base.cc:1034] running on GCE node
I20260807 19:48:34.192533 18936 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:34.194463 18936 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:34.195726 18936 hybrid_clock.cc:648] HybridClock initialized: now 1786132114195664 us; error 65 us; skew 500 ppm
I20260807 19:48:34.196173 18936 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:34 dist-test-slave-2p8l krb5kdc[18918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132114, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:34.200066 18936 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:34.201897 18936 webserver.cc:460] Webserver started at http://127.12.155.190:39577/ using document root <none> and password file <none>
I20260807 19:48:34.202823 18936 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:34.202987 18936 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:34.203382 18936 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:34.207118 18936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "700f0c4adfdd4b6689eb2056be5735ce"
format_stamp: "Formatted at 2026-08-07 19:48:34 on dist-test-slave-2p8l"
server_key: "4b56e2d2cfd2c2349ceb683bf27dc7a1"
server_key_iv: "52ff5fd621c3d8dd67b2c754652cedd2"
server_key_version: "encryptionkey@0"
I20260807 19:48:34.208056 18936 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "700f0c4adfdd4b6689eb2056be5735ce"
format_stamp: "Formatted at 2026-08-07 19:48:34 on dist-test-slave-2p8l"
server_key: "4b56e2d2cfd2c2349ceb683bf27dc7a1"
server_key_iv: "52ff5fd621c3d8dd67b2c754652cedd2"
server_key_version: "encryptionkey@0"
I20260807 19:48:34.214529 18936 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 19:48:34.219264 18962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:34.221043 18936 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:48:34.221266 18936 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "700f0c4adfdd4b6689eb2056be5735ce"
format_stamp: "Formatted at 2026-08-07 19:48:34 on dist-test-slave-2p8l"
server_key: "4b56e2d2cfd2c2349ceb683bf27dc7a1"
server_key_iv: "52ff5fd621c3d8dd67b2c754652cedd2"
server_key_version: "encryptionkey@0"
I20260807 19:48:34.221503 18936 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:34.263931 18936 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:34.269578 18936 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:34.270025 18936 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:34.292946 18936 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:45291
I20260807 19:48:34.292999 19042 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:45291 every 8 connection(s)
I20260807 19:48:34.294788 18936 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:34.299467 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18936
I20260807 19:48:34.299803 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:34.300458 19043 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:34.300885 12910 external_mini_cluster.cc:1428] Setting key 617cc8f8e5f8e81eb6c14211d857ed8b
Aug 07 19:48:34 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132113, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:34.320636 19043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce: Bootstrap starting.
I20260807 19:48:34.325620 19043 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:34.327620 19043 log.cc:824] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:34.331710 19046 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:34.303697 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44716 (local address 127.12.155.190:45291)
0807 19:48:34.304772 (+ 1075us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:34.304794 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:34.304851 (+ 57us) server_negotiation.cc:407] Connection header received
0807 19:48:34.306852 (+ 2001us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:34.306881 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:34.307410 (+ 529us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:34.307838 (+ 428us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:34.310485 (+ 2647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:34.312205 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:34.314387 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:34.315221 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:34.315416 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:34.322022 (+ 6606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:34.322033 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:34.322112 (+ 79us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:34.322205 (+ 93us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:34.326201 (+ 3996us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:34.327461 (+ 1260us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:34.327469 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:34.327477 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:34.327687 (+ 210us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:34.328260 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:34.328268 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:34.328276 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:34.328957 (+ 681us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:34.329381 (+ 424us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:34.329923 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 19:48:34.330481 (+ 558us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":807,"thread_start_us":499,"threads_started":1}
I20260807 19:48:34.331806 19043 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce: No bootstrap required, opened a new log
I20260807 19:48:34.343437 19043 raft_consensus.cc:348] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "700f0c4adfdd4b6689eb2056be5735ce" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45291 } }
I20260807 19:48:34.344002 19043 raft_consensus.cc:374] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:34.344147 19043 raft_consensus.cc:729] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 700f0c4adfdd4b6689eb2056be5735ce, State: Initialized, Role: FOLLOWER
I20260807 19:48:34.344946 19043 consensus_queue.cc:260] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "700f0c4adfdd4b6689eb2056be5735ce" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45291 } }
I20260807 19:48:34.345340 19043 raft_consensus.cc:388] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:34.345530 19043 raft_consensus.cc:482] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:34.345752 19043 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:34.349325 19043 raft_consensus.cc:504] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "700f0c4adfdd4b6689eb2056be5735ce" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45291 } }
I20260807 19:48:34.350034 19043 leader_election.cc:302] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 700f0c4adfdd4b6689eb2056be5735ce; no voters:
I20260807 19:48:34.350971 19043 leader_election.cc:288] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:34.351136 19049 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:34.352110 19049 raft_consensus.cc:686] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [term 1 LEADER]: Becoming Leader. State: Replica: 700f0c4adfdd4b6689eb2056be5735ce, State: Running, Role: LEADER
I20260807 19:48:34.352874 19049 consensus_queue.cc:237] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "700f0c4adfdd4b6689eb2056be5735ce" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45291 } }
I20260807 19:48:34.354219 19043 sys_catalog.cc:564] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:34.357051 19051 sys_catalog.cc:455] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "700f0c4adfdd4b6689eb2056be5735ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "700f0c4adfdd4b6689eb2056be5735ce" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45291 } } }
I20260807 19:48:34.357012 19055 sys_catalog.cc:455] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [sys.catalog]: SysCatalogTable state changed. Reason: New leader 700f0c4adfdd4b6689eb2056be5735ce. Latest consensus state: current_term: 1 leader_uuid: "700f0c4adfdd4b6689eb2056be5735ce" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "700f0c4adfdd4b6689eb2056be5735ce" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45291 } } }
I20260807 19:48:34.357508 19051 sys_catalog.cc:458] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:34.357522 19055 sys_catalog.cc:458] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:34.359968 19067 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:34.365758 19067 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:34.376557 19067 catalog_manager.cc:1347] Generated new cluster ID: b0bc8c1046b5445c85d3a8e1277b6685
I20260807 19:48:34.376706 19067 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:34.417101 19067 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:34.418833 19067 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:34.427019 19067 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 700f0c4adfdd4b6689eb2056be5735ce: Generated new TSK 0
I20260807 19:48:34.428221 19067 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:34.514151 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45291
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:34.952996 19087 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:34.953387 19087 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:34.953500 19087 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:34.961705 19087 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:34.961862 19087 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:34.962002 19087 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:34.973368 19087 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:34.975235 19087 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:34.976945 19087 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:34.993453 19095 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:34.993544 19093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:34.993520 19097 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:34.995165 19087 server_base.cc:1034] running on GCE node
I20260807 19:48:34.995999 19087 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:34.997283 19087 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:34.998540 19087 hybrid_clock.cc:648] HybridClock initialized: now 1786132114998462 us; error 72 us; skew 500 ppm
I20260807 19:48:34.998948 19087 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:35 dist-test-slave-2p8l krb5kdc[18918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:35.003263 19087 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:35.005394 19087 webserver.cc:460] Webserver started at http://127.12.155.129:37679/ using document root <none> and password file <none>
I20260807 19:48:35.006596 19087 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:35.006798 19087 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:35.007305 19087 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:35.011646 19087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "20ecfdd18f154027b5d362d1624e9ca6"
format_stamp: "Formatted at 2026-08-07 19:48:35 on dist-test-slave-2p8l"
server_key: "d594c09be5c99b271735d0413e701bf8"
server_key_iv: "b496fbfecbd9433f5182c91ad0a1ba45"
server_key_version: "encryptionkey@0"
I20260807 19:48:35.012719 19087 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "20ecfdd18f154027b5d362d1624e9ca6"
format_stamp: "Formatted at 2026-08-07 19:48:35 on dist-test-slave-2p8l"
server_key: "d594c09be5c99b271735d0413e701bf8"
server_key_iv: "b496fbfecbd9433f5182c91ad0a1ba45"
server_key_version: "encryptionkey@0"
I20260807 19:48:35.020084 19087 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.003s
I20260807 19:48:35.024911 19109 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:35.026978 19087 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:48:35.027194 19087 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "20ecfdd18f154027b5d362d1624e9ca6"
format_stamp: "Formatted at 2026-08-07 19:48:35 on dist-test-slave-2p8l"
server_key: "d594c09be5c99b271735d0413e701bf8"
server_key_iv: "b496fbfecbd9433f5182c91ad0a1ba45"
server_key_version: "encryptionkey@0"
I20260807 19:48:35.027468 19087 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:35.048137 19087 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:35.056393 19087 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:35.056802 19087 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:35.058234 19087 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:35.060065 19087 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:35.060150 19087 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:35.060313 19087 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:35.060382 19087 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:35.100855 19087 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:42945
I20260807 19:48:35.100895 19302 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:42945 every 8 connection(s)
I20260807 19:48:35.102653 19087 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:35.110859 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 19087
I20260807 19:48:35.111136 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:35.111892 12910 external_mini_cluster.cc:1428] Setting key ffbeeab1cfe3b10d3d1ffa6b145a31d2
Aug 07 19:48:35 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:35.127398 19307 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:35.106240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:42195 (local address 127.12.155.190:45291)
0807 19:48:35.106879 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:35.106885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:35.108081 (+ 1196us) server_negotiation.cc:407] Connection header received
0807 19:48:35.110287 (+ 2206us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:35.110295 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:35.110414 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:35.110585 (+ 171us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:35.112566 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.113733 (+ 1167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.115732 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.116172 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.116327 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:35.120421 (+ 4094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:35.120427 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:35.120431 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:35.120469 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:35.123520 (+ 3051us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:35.124398 (+ 878us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:35.124406 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:35.124415 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:35.124565 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:35.125046 (+ 481us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:35.125055 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:35.125057 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:35.125423 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:35.125591 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:35.126652 (+ 1061us) server_negotiation.cc:299] Negotiation successful
0807 19:48:35.126970 (+ 318us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":447,"thread_start_us":281,"threads_started":1}
I20260807 19:48:35.128670 19311 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:35.106977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45291 (local address 127.12.155.129:42195)
0807 19:48:35.107867 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:35.107923 (+ 56us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:35.109887 (+ 1964us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:35.110807 (+ 920us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:35.110816 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:35.111589 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:35.112362 (+ 773us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:35.112384 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.113913 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.113925 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:35.115557 (+ 1632us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:35.115571 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.116463 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.116474 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:35.116746 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:35.117575 (+ 829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:35.117607 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:35.120159 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:35.123692 (+ 3533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:35.123705 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:35.123729 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:35.124243 (+ 514us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:35.124688 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:35.124693 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:35.124697 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:35.124920 (+ 223us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:35.125560 (+ 640us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:35.125570 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:35.126185 (+ 615us) client_negotiation.cc:769] Sending connection context
0807 19:48:35.126539 (+ 354us) client_negotiation.cc:240] Negotiation successful
0807 19:48:35.127221 (+ 682us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":343,"threads_started":1}
I20260807 19:48:35.130651 19303 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45291
I20260807 19:48:35.131124 19303 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:35.132212 19303 heartbeater.cc:511] Master 127.12.155.190:45291 requested a full tablet report, sending...
I20260807 19:48:35.145139 18987 ts_manager.cc:194] Registered new tserver with Master: 20ecfdd18f154027b5d362d1624e9ca6 (127.12.155.129:42945)
I20260807 19:48:35.147872 18987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:42195
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:35.186864 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45291
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:35.601907 19314 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:35.602427 19314 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:35.602617 19314 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:35.610809 19314 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:35.611007 19314 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:35.611227 19314 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:35.622522 19314 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:35.624430 19314 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:35.626307 19314 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:35.642285 19324 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:35.642242 19325 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:35.642426 19330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:35.643747 19314 server_base.cc:1034] running on GCE node
I20260807 19:48:35.644567 19314 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:35.645756 19314 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:35.647006 19314 hybrid_clock.cc:648] HybridClock initialized: now 1786132115646933 us; error 66 us; skew 500 ppm
I20260807 19:48:35.647369 19314 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:35 dist-test-slave-2p8l krb5kdc[18918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:35.654892 19314 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:35.656713 19314 webserver.cc:460] Webserver started at http://127.12.155.130:41983/ using document root <none> and password file <none>
I20260807 19:48:35.657554 19314 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:35.657667 19314 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:35.657979 19314 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:35.661751 19314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "6b3ffee3e4b744e39d3ccf5228e26d83"
format_stamp: "Formatted at 2026-08-07 19:48:35 on dist-test-slave-2p8l"
server_key: "67ada0b6c334b12fd1937568a6ad8786"
server_key_iv: "2e184dbea6dbca9075122b2feeca3a1a"
server_key_version: "encryptionkey@0"
I20260807 19:48:35.662812 19314 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "6b3ffee3e4b744e39d3ccf5228e26d83"
format_stamp: "Formatted at 2026-08-07 19:48:35 on dist-test-slave-2p8l"
server_key: "67ada0b6c334b12fd1937568a6ad8786"
server_key_iv: "2e184dbea6dbca9075122b2feeca3a1a"
server_key_version: "encryptionkey@0"
I20260807 19:48:35.669656 19314 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:48:35.674594 19343 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:35.676416 19314 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:48:35.676638 19314 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "6b3ffee3e4b744e39d3ccf5228e26d83"
format_stamp: "Formatted at 2026-08-07 19:48:35 on dist-test-slave-2p8l"
server_key: "67ada0b6c334b12fd1937568a6ad8786"
server_key_iv: "2e184dbea6dbca9075122b2feeca3a1a"
server_key_version: "encryptionkey@0"
I20260807 19:48:35.676901 19314 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:35.693109 19314 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:35.698928 19314 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:35.699327 19314 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:35.700917 19314 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:35.702847 19314 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:35.702934 19314 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:35.703104 19314 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:35.703166 19314 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:35.743163 19314 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:42431
I20260807 19:48:35.743211 19525 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:42431 every 8 connection(s)
I20260807 19:48:35.744828 19314 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:35.752197 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 19314
I20260807 19:48:35.752480 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:35.753063 12910 external_mini_cluster.cc:1428] Setting key 4d878a9ce91e9b05fbb95f428c87adac
Aug 07 19:48:35 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132115, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:35.772107 19530 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:35.748289 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:40631 (local address 127.12.155.190:45291)
0807 19:48:35.748872 (+ 583us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:35.748878 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:35.750531 (+ 1653us) server_negotiation.cc:407] Connection header received
0807 19:48:35.753808 (+ 3277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:35.753817 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:35.753935 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:35.754115 (+ 180us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:35.756163 (+ 2048us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.756945 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.758799 (+ 1854us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.759279 (+ 480us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.759425 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:35.763732 (+ 4307us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:35.763738 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:35.763741 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:35.763828 (+ 87us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:35.767792 (+ 3964us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:35.768743 (+ 951us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:35.768751 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:35.768758 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:35.768956 (+ 198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:35.769547 (+ 591us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:35.769555 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:35.769561 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:35.770039 (+ 478us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:35.770238 (+ 199us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:35.771220 (+ 982us) server_negotiation.cc:299] Negotiation successful
0807 19:48:35.771537 (+ 317us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":432,"thread_start_us":282,"threads_started":1}
I20260807 19:48:35.773100 19531 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:35.749036 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45291 (local address 127.12.155.130:40631)
0807 19:48:35.749948 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:35.749998 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:35.753342 (+ 3344us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:35.754432 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:35.754443 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:35.755165 (+ 722us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:35.755980 (+ 815us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:35.756000 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.757111 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.757121 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:35.758619 (+ 1498us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:35.758633 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:35.759553 (+ 920us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:35.759560 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:35.759827 (+ 267us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:35.760723 (+ 896us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:35.760749 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:35.763459 (+ 2710us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:35.767998 (+ 4539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:35.768008 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:35.768032 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:35.768580 (+ 548us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:35.769118 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:35.769122 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:35.769125 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:35.769396 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:35.770212 (+ 816us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:35.770220 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:35.770685 (+ 465us) client_negotiation.cc:769] Sending connection context
0807 19:48:35.771058 (+ 373us) client_negotiation.cc:240] Negotiation successful
0807 19:48:35.771627 (+ 569us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":596,"thread_start_us":337,"threads_started":1}
I20260807 19:48:35.775292 19526 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45291
I20260807 19:48:35.775738 19526 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:35.776744 19526 heartbeater.cc:511] Master 127.12.155.190:45291 requested a full tablet report, sending...
I20260807 19:48:35.778822 18987 ts_manager.cc:194] Registered new tserver with Master: 6b3ffee3e4b744e39d3ccf5228e26d83 (127.12.155.130:42431)
I20260807 19:48:35.779838 18987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:40631
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:35.820745 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45291
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35925
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:36.152523 19303 heartbeater.cc:503] Master 127.12.155.190:45291 was elected leader, sending a full tablet report...
W20260807 19:48:36.237334 19534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:36.237716 19534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:36.237886 19534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:36.245922 19534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:36.246079 19534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:36.246294 19534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:36.257516 19534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35925
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45291
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:36.259438 19534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:36.261152 19534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:36.277158 19543 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:36.277213 19548 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:36.277256 19545 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:36.278357 19534 server_base.cc:1034] running on GCE node
I20260807 19:48:36.279115 19534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:36.280282 19534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:36.281541 19534 hybrid_clock.cc:648] HybridClock initialized: now 1786132116281472 us; error 59 us; skew 500 ppm
I20260807 19:48:36.281957 19534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:36.285995 19534 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:36.287814 19534 webserver.cc:460] Webserver started at http://127.12.155.131:36181/ using document root <none> and password file <none>
I20260807 19:48:36.288688 19534 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:36.288803 19534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:36.289134 19534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:36.292914 19534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "5113ec3508944e1eaa2be2693ae11060"
format_stamp: "Formatted at 2026-08-07 19:48:36 on dist-test-slave-2p8l"
server_key: "2901cb1564c10385a4328d4d5252fe4e"
server_key_iv: "8fb2ceafb6471d1feef960493c5d5f29"
server_key_version: "encryptionkey@0"
I20260807 19:48:36.293897 19534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "5113ec3508944e1eaa2be2693ae11060"
format_stamp: "Formatted at 2026-08-07 19:48:36 on dist-test-slave-2p8l"
server_key: "2901cb1564c10385a4328d4d5252fe4e"
server_key_iv: "8fb2ceafb6471d1feef960493c5d5f29"
server_key_version: "encryptionkey@0"
I20260807 19:48:36.300302 19534 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 19:48:36.304690 19561 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:36.306468 19534 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:36.306685 19534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "5113ec3508944e1eaa2be2693ae11060"
format_stamp: "Formatted at 2026-08-07 19:48:36 on dist-test-slave-2p8l"
server_key: "2901cb1564c10385a4328d4d5252fe4e"
server_key_iv: "8fb2ceafb6471d1feef960493c5d5f29"
server_key_version: "encryptionkey@0"
I20260807 19:48:36.306947 19534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:36.348764 19534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:36.354415 19534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:36.354797 19534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:36.356150 19534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:36.357846 19534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:36.357980 19534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:36.358187 19534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:36.358270 19534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:36.398473 19534 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:42483
I20260807 19:48:36.398578 19745 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:42483 every 8 connection(s)
I20260807 19:48:36.400122 19534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:36.404966 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 19534
I20260807 19:48:36.405229 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestAuthorizedSuperuser.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:36.405895 12910 external_mini_cluster.cc:1428] Setting key 032be13f4eeb29af8e18a7677878d464
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:36.426136 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.403613 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:45941 (local address 127.12.155.190:45291)
0807 19:48:36.404221 (+ 608us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:36.404227 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:36.405498 (+ 1271us) server_negotiation.cc:407] Connection header received
0807 19:48:36.407852 (+ 2354us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:36.407857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:36.407969 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:36.408119 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:36.410503 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.411494 (+ 991us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.413330 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.413751 (+ 421us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.413882 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.418185 (+ 4303us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:36.418191 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:36.418194 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:36.418239 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:36.421931 (+ 3692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.423082 (+ 1151us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.423087 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.423090 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.423265 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.423906 (+ 641us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.423912 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.423916 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.424303 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:36.424448 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:36.425362 (+ 914us) server_negotiation.cc:299] Negotiation successful
0807 19:48:36.425636 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":459,"thread_start_us":268,"threads_started":1}
I20260807 19:48:36.427364 19752 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.404285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45291 (local address 127.12.155.131:45941)
0807 19:48:36.405270 (+ 985us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:36.405334 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:36.407545 (+ 2211us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:36.408428 (+ 883us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:36.408445 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:36.409350 (+ 905us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:36.410329 (+ 979us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:36.410352 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.411634 (+ 1282us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.411638 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:36.413166 (+ 1528us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:36.413179 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.413968 (+ 789us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.413972 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:36.414259 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.415109 (+ 850us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:36.415138 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:36.417898 (+ 2760us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:36.422167 (+ 4269us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:36.422178 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:36.422199 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:36.422903 (+ 704us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:36.423445 (+ 542us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:36.423450 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:36.423453 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:36.423746 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:36.424442 (+ 696us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:36.424449 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:36.424923 (+ 474us) client_negotiation.cc:769] Sending connection context
0807 19:48:36.425203 (+ 280us) client_negotiation.cc:240] Negotiation successful
0807 19:48:36.425726 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":668,"thread_start_us":438,"threads_started":1}
I20260807 19:48:36.428968 19746 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45291
I20260807 19:48:36.429327 19746 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:36.430281 19746 heartbeater.cc:511] Master 127.12.155.190:45291 requested a full tablet report, sending...
I20260807 19:48:36.432142 18987 ts_manager.cc:194] Registered new tserver with Master: 5113ec3508944e1eaa2be2693ae11060 (127.12.155.131:42483)
I20260807 19:48:36.433213 18987 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:45941
I20260807 19:48:36.436558 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:36.505254 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.486123 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58426 (local address 127.12.155.129:42945)
0807 19:48:36.486923 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:36.486932 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:36.486968 (+ 36us) server_negotiation.cc:407] Connection header received
0807 19:48:36.487050 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:36.487057 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:36.487348 (+ 291us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:36.487514 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:36.489470 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.490806 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.492132 (+ 1326us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.492876 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.492989 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.497733 (+ 4744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:36.497838 (+ 105us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:36.497860 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:36.497908 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:36.501703 (+ 3795us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.502517 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.502527 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.502529 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.502680 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.503284 (+ 604us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.503288 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.503291 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.503745 (+ 454us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:36.504045 (+ 300us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:36.504424 (+ 379us) server_negotiation.cc:299] Negotiation successful
0807 19:48:36.504704 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":562,"thread_start_us":352,"threads_started":1}
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:36.528723 19750 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.511336 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53030 (local address 127.12.155.190:45291)
0807 19:48:36.511654 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:36.511663 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:36.511956 (+ 293us) server_negotiation.cc:407] Connection header received
0807 19:48:36.512190 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:36.512196 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:36.512335 (+ 139us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:36.512452 (+ 117us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:36.514047 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.515111 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.516626 (+ 1515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.517119 (+ 493us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.517210 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.522023 (+ 4813us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:36.522030 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:36.522034 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:36.522162 (+ 128us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:36.525525 (+ 3363us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.526369 (+ 844us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.526374 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.526376 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.526546 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.527096 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.527100 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.527102 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.527530 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:36.527741 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:36.528153 (+ 412us) server_negotiation.cc:299] Negotiation successful
0807 19:48:36.528407 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
W20260807 19:48:36.529493 18987 server_base.cc:1116] Unauthorized access attempt to method kudu.master.MasterService.TSHeartbeat from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53030
I20260807 19:48:36.530784 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 19087
I20260807 19:48:36.545132 19762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.532064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58440 (local address 127.12.155.129:42945)
0807 19:48:36.532317 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:36.532326 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:36.532348 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:48:36.532498 (+ 150us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:36.532502 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:36.532594 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:36.532680 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:36.534108 (+ 1428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.534873 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.536244 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.536713 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.536815 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.539433 (+ 2618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:36.539438 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:36.539442 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:36.539481 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:36.542579 (+ 3098us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.543258 (+ 679us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.543266 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.543273 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.543432 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.543769 (+ 337us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.543772 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.543774 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.544046 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:36.544229 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:36.544531 (+ 302us) server_negotiation.cc:299] Negotiation successful
0807 19:48:36.544718 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:48:36.545996 19298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:36.638523 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 19087
I20260807 19:48:36.671056 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 19314
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:36.690228 19768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.672455 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56694 (local address 127.12.155.130:42431)
0807 19:48:36.673075 (+ 620us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:36.673084 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:36.673116 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:48:36.673199 (+ 83us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:36.673207 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:36.673506 (+ 299us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:36.673664 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:36.675128 (+ 1464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.676226 (+ 1098us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.677656 (+ 1430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.678435 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.678585 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.683650 (+ 5065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:36.683664 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:36.683684 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:36.683731 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:36.687078 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.687892 (+ 814us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.687901 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.687903 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.688042 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.688445 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.688449 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.688451 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.688916 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:36.689209 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:36.689514 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 19:48:36.689773 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":442,"thread_start_us":311,"threads_started":1}
I20260807 19:48:36.691886 19521 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:36.784037 19526 heartbeater.cc:503] Master 127.12.155.190:45291 was elected leader, sending a full tablet report...
I20260807 19:48:36.785517 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 19314
W20260807 19:48:36.812742 18969 connection.cc:535] server connection from 127.12.155.130:40631 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 19:48:36.812950 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 19534
Aug 07 19:48:36 dist-test-slave-2p8l krb5kdc[18918](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132116, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:36.834035 19772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:36.814100 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42976 (local address 127.12.155.131:42483)
0807 19:48:36.814766 (+ 666us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:36.814775 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:36.814820 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:48:36.814908 (+ 88us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:36.814916 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:36.815197 (+ 281us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:36.815370 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:36.816778 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.818234 (+ 1456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.819687 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:36.820336 (+ 649us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:36.820451 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:36.825724 (+ 5273us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:36.825740 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:36.825763 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:36.825823 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:36.829245 (+ 3422us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.830362 (+ 1117us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.830379 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.830386 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.830575 (+ 189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:36.831046 (+ 471us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:36.831052 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:36.831055 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:36.831672 (+ 617us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:36.832042 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:36.833293 (+ 1251us) server_negotiation.cc:299] Negotiation successful
0807 19:48:36.833636 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":472,"thread_start_us":317,"threads_started":1}
I20260807 19:48:36.835983 19739 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:36.928298 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 19534
I20260807 19:48:36.964720 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18936
I20260807 19:48:36.966684 19034 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:37.092589 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18936
2026-08-07T19:48:37Z chronyd exiting
[ OK ] SecurityITest.TestAuthorizedSuperuser (5104 ms)
[ RUN ] SecurityITest.TestDisableWebUI
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:37 dist-test-slave-2p8l krb5kdc[19778](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:37 dist-test-slave-2p8l krb5kdc[19778](info): set up 2 sockets
Aug 07 19:48:37 dist-test-slave-2p8l krb5kdc[19778](info): commencing operation
krb5kdc: starting...
W20260807 19:48:38.527940 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.000s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:38 dist-test-slave-2p8l krb5kdc[19778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:38Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:38Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:38.819228 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38791
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:38791
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:39.233981 19804 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:39.234403 19804 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:39.234516 19804 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:39.242502 19804 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:39.242646 19804 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:39.242702 19804 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:39.242765 19804 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:39.242818 19804 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:39.253970 19804 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:38791
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38791
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:39.255841 19804 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:39.257558 19804 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:39.272337 19812 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:39.272315 19815 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:39.272282 19811 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:39.273476 19804 server_base.cc:1034] running on GCE node
I20260807 19:48:39.274540 19804 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:39.276280 19804 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:39.277491 19804 hybrid_clock.cc:648] HybridClock initialized: now 1786132119277428 us; error 56 us; skew 500 ppm
I20260807 19:48:39.277855 19804 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:39 dist-test-slave-2p8l krb5kdc[19778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132119, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:39.281672 19804 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:39.283298 19804 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:39.283452 19804 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:39.283862 19804 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:39.287698 19804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "2bb54873ddfc47febd341eae0d5fdea5"
format_stamp: "Formatted at 2026-08-07 19:48:39 on dist-test-slave-2p8l"
server_key: "8ca4e918d62bfc9f22e02bcdfa3be885"
server_key_iv: "d318e4c429bd2a44bc5ef4fbfeb7d073"
server_key_version: "encryptionkey@0"
I20260807 19:48:39.288678 19804 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "2bb54873ddfc47febd341eae0d5fdea5"
format_stamp: "Formatted at 2026-08-07 19:48:39 on dist-test-slave-2p8l"
server_key: "8ca4e918d62bfc9f22e02bcdfa3be885"
server_key_iv: "d318e4c429bd2a44bc5ef4fbfeb7d073"
server_key_version: "encryptionkey@0"
I20260807 19:48:39.294952 19804 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 19:48:39.299315 19824 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:39.301419 19804 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:48:39.301611 19804 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "2bb54873ddfc47febd341eae0d5fdea5"
format_stamp: "Formatted at 2026-08-07 19:48:39 on dist-test-slave-2p8l"
server_key: "8ca4e918d62bfc9f22e02bcdfa3be885"
server_key_iv: "d318e4c429bd2a44bc5ef4fbfeb7d073"
server_key_version: "encryptionkey@0"
I20260807 19:48:39.301880 19804 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:39.320170 19804 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:39.326140 19804 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:39.326473 19804 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:39.350742 19804 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:38791
I20260807 19:48:39.350796 19905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:38791 every 8 connection(s)
I20260807 19:48:39.352061 19804 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:39.357228 19907 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:39.360642 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 19804
I20260807 19:48:39.360924 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:39.361738 12910 external_mini_cluster.cc:1428] Setting key a68ec332fc01d6b508ca01e7d011c2af
I20260807 19:48:39.372213 19907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5: Bootstrap starting.
I20260807 19:48:39.376446 19907 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:39.377883 19907 log.cc:824] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:48:39 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:39.381531 19907 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5: No bootstrap required, opened a new log
I20260807 19:48:39.388543 19916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:39.364562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53100 (local address 127.12.155.190:38791)
0807 19:48:39.365583 (+ 1021us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:39.365598 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:39.365652 (+ 54us) server_negotiation.cc:407] Connection header received
0807 19:48:39.367679 (+ 2027us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:39.367711 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:39.368244 (+ 533us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:39.368748 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:39.370605 (+ 1857us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:39.372016 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:39.373519 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:39.374363 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:39.374609 (+ 246us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:39.379622 (+ 5013us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:39.379632 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:39.379650 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:39.379690 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:39.383231 (+ 3541us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:39.384323 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:39.384331 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:39.384339 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:39.384573 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:39.385092 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:39.385095 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:39.385097 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:39.385800 (+ 703us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:39.386165 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:39.386654 (+ 489us) server_negotiation.cc:299] Negotiation successful
0807 19:48:39.387149 (+ 495us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":751,"thread_start_us":453,"threads_started":1}
I20260807 19:48:39.392871 19907 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bb54873ddfc47febd341eae0d5fdea5" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38791 } }
I20260807 19:48:39.393368 19907 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:39.393498 19907 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2bb54873ddfc47febd341eae0d5fdea5, State: Initialized, Role: FOLLOWER
I20260807 19:48:39.394362 19907 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bb54873ddfc47febd341eae0d5fdea5" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38791 } }
I20260807 19:48:39.394652 19907 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:39.394851 19907 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:39.395053 19907 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:39.398255 19907 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bb54873ddfc47febd341eae0d5fdea5" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38791 } }
I20260807 19:48:39.398967 19907 leader_election.cc:302] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2bb54873ddfc47febd341eae0d5fdea5; no voters:
I20260807 19:48:39.399705 19907 leader_election.cc:288] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:39.399860 19919 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:39.400787 19919 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [term 1 LEADER]: Becoming Leader. State: Replica: 2bb54873ddfc47febd341eae0d5fdea5, State: Running, Role: LEADER
I20260807 19:48:39.401516 19919 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bb54873ddfc47febd341eae0d5fdea5" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38791 } }
I20260807 19:48:39.402611 19907 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:39.404834 19922 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2bb54873ddfc47febd341eae0d5fdea5. Latest consensus state: current_term: 1 leader_uuid: "2bb54873ddfc47febd341eae0d5fdea5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bb54873ddfc47febd341eae0d5fdea5" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38791 } } }
I20260807 19:48:39.405236 19922 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:39.405450 19920 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2bb54873ddfc47febd341eae0d5fdea5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2bb54873ddfc47febd341eae0d5fdea5" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38791 } } }
I20260807 19:48:39.406181 19920 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:39.414129 19927 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:39.421319 19927 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:39.433557 19927 catalog_manager.cc:1347] Generated new cluster ID: 21447c2cf2e544a48a7fb811f2d8526a
I20260807 19:48:39.433756 19927 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:39.449142 19927 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:39.450929 19927 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:39.460836 19927 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5: Generated new TSK 0
I20260807 19:48:39.462028 19927 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:39.554411 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:38791
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:39.998549 19956 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:39.998936 19956 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:39.999117 19956 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:40.007755 19956 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:40.007954 19956 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:40.008172 19956 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:40.020006 19956 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:38791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:40.021932 19956 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:40.023778 19956 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:40.040305 19966 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:40.040313 19969 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:40.040292 19967 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:40.041445 19956 server_base.cc:1034] running on GCE node
I20260807 19:48:40.042300 19956 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:40.043553 19956 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:40.044814 19956 hybrid_clock.cc:648] HybridClock initialized: now 1786132120044760 us; error 52 us; skew 500 ppm
I20260807 19:48:40.045265 19956 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:40 dist-test-slave-2p8l krb5kdc[19778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:40.049401 19956 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:40.050940 19956 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:40.051092 19956 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:40.051499 19956 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:40.055287 19956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "b6190060b695454eb3b79dcc15e237dd"
format_stamp: "Formatted at 2026-08-07 19:48:40 on dist-test-slave-2p8l"
server_key: "7d7008226aaa3e43c37c63649604c92d"
server_key_iv: "a1e15df8b8831348cbb47a5ece9c1014"
server_key_version: "encryptionkey@0"
I20260807 19:48:40.056262 19956 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "b6190060b695454eb3b79dcc15e237dd"
format_stamp: "Formatted at 2026-08-07 19:48:40 on dist-test-slave-2p8l"
server_key: "7d7008226aaa3e43c37c63649604c92d"
server_key_iv: "a1e15df8b8831348cbb47a5ece9c1014"
server_key_version: "encryptionkey@0"
I20260807 19:48:40.062891 19956 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 19:48:40.067193 19981 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:40.068924 19956 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:48:40.069159 19956 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "b6190060b695454eb3b79dcc15e237dd"
format_stamp: "Formatted at 2026-08-07 19:48:40 on dist-test-slave-2p8l"
server_key: "7d7008226aaa3e43c37c63649604c92d"
server_key_iv: "a1e15df8b8831348cbb47a5ece9c1014"
server_key_version: "encryptionkey@0"
I20260807 19:48:40.069438 19956 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:40.083616 19956 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:40.089025 19956 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:40.089386 19956 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:40.090716 19956 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:40.092434 19956 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:40.092571 19956 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:40.092722 19956 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:40.092823 19956 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:40.132454 19956 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:40129
I20260807 19:48:40.132491 20183 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:40129 every 8 connection(s)
I20260807 19:48:40.133641 19956 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:40.139797 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 19956
I20260807 19:48:40.140122 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:40.141237 12910 external_mini_cluster.cc:1428] Setting key 575a220840801469e956494ebc2ee307
Aug 07 19:48:40 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:40.162712 20187 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:40.137179 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:52173 (local address 127.12.155.190:38791)
0807 19:48:40.137852 (+ 673us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:40.137860 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:40.139175 (+ 1315us) server_negotiation.cc:407] Connection header received
0807 19:48:40.142609 (+ 3434us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:40.142617 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:40.142754 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:40.142928 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:40.145494 (+ 2566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.146403 (+ 909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.149482 (+ 3079us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.150213 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.150355 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:40.156101 (+ 5746us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:40.156107 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:40.156110 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:40.156151 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:40.159201 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:40.160021 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:40.160028 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:40.160032 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:40.160176 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:40.160645 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:40.160652 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:40.160655 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:40.160991 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:40.161154 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:40.161983 (+ 829us) server_negotiation.cc:299] Negotiation successful
0807 19:48:40.162274 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":494,"thread_start_us":318,"threads_started":1}
I20260807 19:48:40.163991 20189 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:40.137808 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38791 (local address 127.12.155.129:52173)
0807 19:48:40.138894 (+ 1086us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:40.138952 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:40.142199 (+ 3247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:40.143269 (+ 1070us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:40.143281 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:40.144125 (+ 844us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:40.145269 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:40.145306 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.146620 (+ 1314us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.146630 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:40.149292 (+ 2662us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:40.149317 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.150514 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.150527 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:40.150953 (+ 426us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:40.152064 (+ 1111us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:40.152111 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:40.155827 (+ 3716us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:40.159378 (+ 3551us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:40.159389 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:40.159411 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:40.159882 (+ 471us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:40.160302 (+ 420us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:40.160308 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:40.160312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:40.160531 (+ 219us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:40.161133 (+ 602us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:40.161142 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:40.161550 (+ 408us) client_negotiation.cc:769] Sending connection context
0807 19:48:40.161860 (+ 310us) client_negotiation.cc:240] Negotiation successful
0807 19:48:40.162529 (+ 669us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":726,"thread_start_us":450,"threads_started":1}
I20260807 19:48:40.166045 20184 heartbeater.cc:347] Connected to a master server at 127.12.155.190:38791
I20260807 19:48:40.166487 20184 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:40.167308 20184 heartbeater.cc:511] Master 127.12.155.190:38791 requested a full tablet report, sending...
I20260807 19:48:40.170588 19852 ts_manager.cc:194] Registered new tserver with Master: b6190060b695454eb3b79dcc15e237dd (127.12.155.129:40129)
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
I20260807 19:48:40.173458 19852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:52173
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:40.210803 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:38791
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:40.628939 20193 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:40.629338 20193 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:40.629563 20193 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:40.637929 20193 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:40.638132 20193 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:40.638286 20193 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:40.649878 20193 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:38791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:40.651856 20193 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:40.653568 20193 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:40.669287 20202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:40.669317 20209 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:40.670006 20201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:40.670457 20193 server_base.cc:1034] running on GCE node
I20260807 19:48:40.671201 20193 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:40.672398 20193 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:40.673641 20193 hybrid_clock.cc:648] HybridClock initialized: now 1786132120673597 us; error 38 us; skew 500 ppm
I20260807 19:48:40.674111 20193 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:40 dist-test-slave-2p8l krb5kdc[19778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:40.682762 20193 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:40.684437 20193 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:40.684612 20193 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:40.685024 20193 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:40.688941 20193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "369ea4021a134458967b955cc6335158"
format_stamp: "Formatted at 2026-08-07 19:48:40 on dist-test-slave-2p8l"
server_key: "60b87ff1d220280a81c83d279e91ba1f"
server_key_iv: "157eba2161609561b23dae37e3195f6a"
server_key_version: "encryptionkey@0"
I20260807 19:48:40.689929 20193 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "369ea4021a134458967b955cc6335158"
format_stamp: "Formatted at 2026-08-07 19:48:40 on dist-test-slave-2p8l"
server_key: "60b87ff1d220280a81c83d279e91ba1f"
server_key_iv: "157eba2161609561b23dae37e3195f6a"
server_key_version: "encryptionkey@0"
I20260807 19:48:40.696453 20193 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:40.701196 20217 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:40.703299 20193 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:48:40.703554 20193 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "369ea4021a134458967b955cc6335158"
format_stamp: "Formatted at 2026-08-07 19:48:40 on dist-test-slave-2p8l"
server_key: "60b87ff1d220280a81c83d279e91ba1f"
server_key_iv: "157eba2161609561b23dae37e3195f6a"
server_key_version: "encryptionkey@0"
I20260807 19:48:40.703845 20193 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:40.739053 20193 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:40.744727 20193 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:40.745082 20193 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:40.746456 20193 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:40.748137 20193 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:40.748273 20193 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:40.748420 20193 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:40.748517 20193 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:40.788339 20193 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:42359
I20260807 19:48:40.788437 20393 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:42359 every 8 connection(s)
I20260807 19:48:40.789552 20193 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:40.794142 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 20193
I20260807 19:48:40.794458 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:40.795295 12910 external_mini_cluster.cc:1428] Setting key 4a9255dbf80a0220abe2170db4bb9035
Aug 07 19:48:40 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132120, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:40.816345 20398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:40.793037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:49989 (local address 127.12.155.190:38791)
0807 19:48:40.793763 (+ 726us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:40.793775 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:40.795112 (+ 1337us) server_negotiation.cc:407] Connection header received
0807 19:48:40.798217 (+ 3105us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:40.798225 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:40.798353 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:40.798513 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:40.800677 (+ 2164us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.801614 (+ 937us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.803933 (+ 2319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.804513 (+ 580us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.804712 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:40.809361 (+ 4649us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:40.809368 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:40.809372 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:40.809415 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:40.812605 (+ 3190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:40.813453 (+ 848us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:40.813459 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:40.813461 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:40.813590 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:40.814099 (+ 509us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:40.814106 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:40.814109 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:40.814495 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:40.814666 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:40.815614 (+ 948us) server_negotiation.cc:299] Negotiation successful
0807 19:48:40.815886 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":523,"thread_start_us":324,"threads_started":1}
I20260807 19:48:40.817611 20401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:40.793698 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38791 (local address 127.12.155.130:49989)
0807 19:48:40.794822 (+ 1124us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:40.794901 (+ 79us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:40.797733 (+ 2832us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:40.798850 (+ 1117us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:40.798862 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:40.799596 (+ 734us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:40.800426 (+ 830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:40.800459 (+ 33us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.801841 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.801846 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:40.803727 (+ 1881us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:40.803743 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:40.804834 (+ 1091us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:40.804844 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:40.805152 (+ 308us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:40.806180 (+ 1028us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:40.806211 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:40.809044 (+ 2833us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:40.812759 (+ 3715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:40.812772 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:40.812794 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:40.813307 (+ 513us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:40.813711 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:40.813717 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:40.813721 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:40.813938 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:40.814655 (+ 717us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:40.814665 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:40.815145 (+ 480us) client_negotiation.cc:769] Sending connection context
0807 19:48:40.815506 (+ 361us) client_negotiation.cc:240] Negotiation successful
0807 19:48:40.816160 (+ 654us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":713,"thread_start_us":442,"threads_started":1}
I20260807 19:48:40.819496 20394 heartbeater.cc:347] Connected to a master server at 127.12.155.190:38791
I20260807 19:48:40.819944 20394 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:40.820861 20394 heartbeater.cc:511] Master 127.12.155.190:38791 requested a full tablet report, sending...
I20260807 19:48:40.822830 19852 ts_manager.cc:194] Registered new tserver with Master: 369ea4021a134458967b955cc6335158 (127.12.155.130:42359)
I20260807 19:48:40.824282 19852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:49989
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:40.865393 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:38791
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40923
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--webserver_enabled=0 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:41.177430 20184 heartbeater.cc:503] Master 127.12.155.190:38791 was elected leader, sending a full tablet report...
W20260807 19:48:41.284372 20406 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:41.284839 20406 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:41.285043 20406 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:41.293370 20406 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:41.293574 20406 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:41.293795 20406 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:41.305284 20406 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40923
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--webserver_enabled=false
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:38791
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:41.307415 20406 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:41.309312 20406 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:41.325707 20412 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:41.325625 20413 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:41.325662 20415 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:41.326787 20406 server_base.cc:1034] running on GCE node
I20260807 19:48:41.327540 20406 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:41.328682 20406 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:41.329924 20406 hybrid_clock.cc:648] HybridClock initialized: now 1786132121329867 us; error 47 us; skew 500 ppm
I20260807 19:48:41.330430 20406 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:41 dist-test-slave-2p8l krb5kdc[19778](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132121, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:41.334211 20406 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:41.335620 20406 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:41.335767 20406 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:41.336134 20406 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:41.339722 20406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "bb589e2895ff4b32aa1f6276be5f5460"
format_stamp: "Formatted at 2026-08-07 19:48:41 on dist-test-slave-2p8l"
server_key: "0fc484a1beba615e36aba6239fd7dee3"
server_key_iv: "df97b25fae3b2bd3b6da51628a30456d"
server_key_version: "encryptionkey@0"
I20260807 19:48:41.340672 20406 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "bb589e2895ff4b32aa1f6276be5f5460"
format_stamp: "Formatted at 2026-08-07 19:48:41 on dist-test-slave-2p8l"
server_key: "0fc484a1beba615e36aba6239fd7dee3"
server_key_iv: "df97b25fae3b2bd3b6da51628a30456d"
server_key_version: "encryptionkey@0"
I20260807 19:48:41.346921 20406 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 19:48:41.351019 20423 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:41.352811 20406 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:48:41.352989 20406 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "bb589e2895ff4b32aa1f6276be5f5460"
format_stamp: "Formatted at 2026-08-07 19:48:41 on dist-test-slave-2p8l"
server_key: "0fc484a1beba615e36aba6239fd7dee3"
server_key_iv: "df97b25fae3b2bd3b6da51628a30456d"
server_key_version: "encryptionkey@0"
I20260807 19:48:41.353232 20406 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:41.375962 20406 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:41.381248 20406 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:41.381561 20406 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:41.382791 20406 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:41.384352 20406 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:41.384465 20406 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:41.384568 20406 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:41.384627 20406 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:41.424118 20406 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:45653
I20260807 19:48:41.424284 20606 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:45653 every 8 connection(s)
I20260807 19:48:41.425277 20406 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:41.427793 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 20406
I20260807 19:48:41.428048 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:41.428740 12910 external_mini_cluster.cc:1428] Setting key 25eeae8b94904b741c818c09b5fdf4c9
Aug 07 19:48:41 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132121, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:41.449160 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.428651 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:58865 (local address 127.12.155.190:38791)
0807 19:48:41.429269 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.429275 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.430732 (+ 1457us) server_negotiation.cc:407] Connection header received
0807 19:48:41.433349 (+ 2617us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.433355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.433461 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.433601 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:41.435481 (+ 1880us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.436332 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.438304 (+ 1972us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.438804 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.438953 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.442716 (+ 3763us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:41.442722 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:41.442726 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:41.442763 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:41.446146 (+ 3383us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:41.446889 (+ 743us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:41.446893 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:41.446895 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:41.447030 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:41.447421 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:41.447424 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:41.447426 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:41.447699 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:41.447819 (+ 120us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.448642 (+ 823us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.448838 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":470,"thread_start_us":297,"threads_started":1}
I20260807 19:48:41.450377 20611 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.429444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38791 (local address 127.12.155.131:58865)
0807 19:48:41.430519 (+ 1075us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:41.430580 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:41.433028 (+ 2448us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:41.433871 (+ 843us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:41.433887 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:41.434559 (+ 672us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:41.435274 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.435294 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.436502 (+ 1208us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.436513 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.438148 (+ 1635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.438162 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.439061 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.439069 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.439318 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.440045 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:41.440070 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:41.442483 (+ 2413us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:41.446274 (+ 3791us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:41.446282 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:41.446297 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:41.446776 (+ 479us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:41.447121 (+ 345us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:41.447125 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:41.447127 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:41.447314 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:41.447894 (+ 580us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:41.447902 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:41.448267 (+ 365us) client_negotiation.cc:769] Sending connection context
0807 19:48:41.448528 (+ 261us) client_negotiation.cc:240] Negotiation successful
0807 19:48:41.448981 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":694,"thread_start_us":386,"threads_started":1}
I20260807 19:48:41.451982 20607 heartbeater.cc:347] Connected to a master server at 127.12.155.190:38791
I20260807 19:48:41.452355 20607 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:41.453148 20607 heartbeater.cc:511] Master 127.12.155.190:38791 requested a full tablet report, sending...
I20260807 19:48:41.454828 19852 ts_manager.cc:194] Registered new tserver with Master: bb589e2895ff4b32aa1f6276be5f5460 (127.12.155.131:45653)
I20260807 19:48:41.455791 19852 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:58865
I20260807 19:48:41.457657 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:48:41.478320 20610 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.463146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53108 (local address 127.12.155.190:38791)
0807 19:48:41.463390 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.463397 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.463932 (+ 535us) server_negotiation.cc:407] Connection header received
0807 19:48:41.464091 (+ 159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.464095 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.464173 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.464282 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:41.465907 (+ 1625us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.466866 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.468309 (+ 1443us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.468746 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.468864 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.471618 (+ 2754us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:41.471625 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:41.471629 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:41.471684 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:41.475068 (+ 3384us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:41.475954 (+ 886us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:41.475959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:41.475961 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:41.476110 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:41.476558 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:41.476563 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:41.476565 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:41.477029 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:41.477276 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.477598 (+ 322us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.477815 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:48:41.483788 19852 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53108:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:41.492079 19852 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:41.531468 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.508643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52980 (local address 127.12.155.129:40129)
0807 19:48:41.520352 (+ 11709us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.520362 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.520400 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:48:41.520551 (+ 151us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.520562 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.520894 (+ 332us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.521170 (+ 276us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:41.522279 (+ 1109us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.524296 (+ 2017us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.527397 (+ 3101us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.529132 (+ 1735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.529356 (+ 224us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.529619 (+ 263us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.530739 (+ 1120us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.531002 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":11449,"thread_start_us":11231,"threads_started":1}
I20260807 19:48:41.531971 20630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.509379 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49948 (local address 127.12.155.131:45653)
0807 19:48:41.518204 (+ 8825us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.518219 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.520774 (+ 2555us) server_negotiation.cc:407] Connection header received
0807 19:48:41.521669 (+ 895us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.521681 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.521969 (+ 288us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.522200 (+ 231us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:41.524438 (+ 2238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.526532 (+ 2094us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.529094 (+ 2562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.530690 (+ 1596us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.530939 (+ 249us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.531150 (+ 211us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.531358 (+ 208us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.531553 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8506,"thread_start_us":8833,"threads_started":1}
I20260807 19:48:41.532059 20624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.508578 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:45653 (local address 127.0.0.1:49948)
0807 19:48:41.520629 (+ 12051us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:41.520649 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:41.520800 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:41.522197 (+ 1397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:41.522203 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:41.522228 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:41.524181 (+ 1953us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.524197 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.526670 (+ 2473us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.526677 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.528899 (+ 2222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.528914 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.530918 (+ 2004us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.530927 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.531136 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.531192 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 19:48:41.531315 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 19:48:41.531584 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11918,"mutex_wait_us":61,"thread_start_us":10084,"threads_started":1}
I20260807 19:48:41.532258 20631 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.521070 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:42359 (local address 127.0.0.1:52638)
0807 19:48:41.524076 (+ 3006us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:41.524102 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:41.524250 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:41.524917 (+ 667us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:41.524922 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:41.524949 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:41.525461 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.525478 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.527476 (+ 1998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.527483 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.529120 (+ 1637us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.529135 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.531333 (+ 2198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.531340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.531510 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.531541 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:48:41.531629 (+ 88us) client_negotiation.cc:240] Negotiation successful
0807 19:48:41.531796 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2848,"mutex_wait_us":40,"thread_start_us":2637,"threads_started":1}
I20260807 19:48:41.533020 20625 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.508439 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:40129 (local address 127.0.0.1:52980)
0807 19:48:41.519173 (+ 10734us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:41.519237 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:41.519478 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:41.521178 (+ 1700us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:41.521187 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:41.521233 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:41.521940 (+ 707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.521963 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.524533 (+ 2570us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.524540 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.527188 (+ 2648us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.527203 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.530173 (+ 2970us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.530180 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.530401 (+ 221us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.530466 (+ 65us) client_negotiation.cc:769] Sending connection context
0807 19:48:41.532558 (+ 2092us) client_negotiation.cc:240] Negotiation successful
0807 19:48:41.532715 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10401,"thread_start_us":11876,"threads_started":1}
I20260807 19:48:41.533274 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.521252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52638 (local address 127.12.155.130:42359)
0807 19:48:41.522052 (+ 800us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.522106 (+ 54us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.524259 (+ 2153us) server_negotiation.cc:407] Connection header received
0807 19:48:41.524397 (+ 138us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.524408 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.524676 (+ 268us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.524914 (+ 238us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:41.525673 (+ 759us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.527331 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.529331 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.530833 (+ 1502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.531010 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.531226 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.532745 (+ 1519us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.532928 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":614,"thread_start_us":999,"threads_started":1}
I20260807 19:48:41.537001 20497 tablet_service.cc:1467] Processing CreateTablet for tablet d3c180e310e4476ab57a71b203c24bb8 (DEFAULT_TABLE table=test-table [id=2289d666fb3a4797a47c82aad20fd7c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:41.537194 20070 tablet_service.cc:1467] Processing CreateTablet for tablet d3c180e310e4476ab57a71b203c24bb8 (DEFAULT_TABLE table=test-table [id=2289d666fb3a4797a47c82aad20fd7c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:41.537194 20289 tablet_service.cc:1467] Processing CreateTablet for tablet d3c180e310e4476ab57a71b203c24bb8 (DEFAULT_TABLE table=test-table [id=2289d666fb3a4797a47c82aad20fd7c0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:41.538800 20497 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c180e310e4476ab57a71b203c24bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:41.538807 20289 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c180e310e4476ab57a71b203c24bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:41.538803 20070 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d3c180e310e4476ab57a71b203c24bb8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:41.553717 20633 tablet_bootstrap.cc:492] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Bootstrap starting.
I20260807 19:48:41.557835 20633 tablet_bootstrap.cc:654] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:41.559039 20635 tablet_bootstrap.cc:492] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Bootstrap starting.
I20260807 19:48:41.559589 20633 log.cc:824] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:41.561368 20634 tablet_bootstrap.cc:492] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Bootstrap starting.
I20260807 19:48:41.563879 20635 tablet_bootstrap.cc:654] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:41.565423 20635 log.cc:824] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:41.565866 20634 tablet_bootstrap.cc:654] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:41.566799 20633 tablet_bootstrap.cc:492] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: No bootstrap required, opened a new log
I20260807 19:48:41.567152 20633 ts_tablet_manager.cc:1397] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260807 19:48:41.567477 20634 log.cc:824] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:41.569344 20635 tablet_bootstrap.cc:492] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: No bootstrap required, opened a new log
I20260807 19:48:41.569660 20635 ts_tablet_manager.cc:1397] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Time spent bootstrapping tablet: real 0.011s user 0.008s sys 0.000s
I20260807 19:48:41.571051 20634 tablet_bootstrap.cc:492] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: No bootstrap required, opened a new log
I20260807 19:48:41.571424 20634 ts_tablet_manager.cc:1397] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 19:48:41.576960 20633 raft_consensus.cc:348] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.577482 20633 raft_consensus.cc:374] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:41.577631 20633 raft_consensus.cc:729] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: bb589e2895ff4b32aa1f6276be5f5460, State: Initialized, Role: FOLLOWER
I20260807 19:48:41.578467 20633 consensus_queue.cc:260] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.579978 20607 heartbeater.cc:503] Master 127.12.155.190:38791 was elected leader, sending a full tablet report...
I20260807 19:48:41.580597 20633 ts_tablet_manager.cc:1428] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Time spent starting tablet: real 0.013s user 0.013s sys 0.000s
I20260807 19:48:41.583647 20634 raft_consensus.cc:348] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.583652 20635 raft_consensus.cc:348] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.584168 20635 raft_consensus.cc:374] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:41.584172 20634 raft_consensus.cc:374] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:41.584327 20635 raft_consensus.cc:729] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6190060b695454eb3b79dcc15e237dd, State: Initialized, Role: FOLLOWER
I20260807 19:48:41.584342 20634 raft_consensus.cc:729] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 369ea4021a134458967b955cc6335158, State: Initialized, Role: FOLLOWER
I20260807 19:48:41.585165 20635 consensus_queue.cc:260] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.585168 20634 consensus_queue.cc:260] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.588902 20394 heartbeater.cc:503] Master 127.12.155.190:38791 was elected leader, sending a full tablet report...
I20260807 19:48:41.590322 20635 ts_tablet_manager.cc:1428] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Time spent starting tablet: real 0.021s user 0.008s sys 0.014s
I20260807 19:48:41.591795 20634 ts_tablet_manager.cc:1428] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Time spent starting tablet: real 0.020s user 0.017s sys 0.000s
W20260807 19:48:41.636866 20185 tablet.cc:2369] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:48:41.677314 20608 tablet.cc:2369] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:41.745211 20642 raft_consensus.cc:482] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:41.745683 20642 raft_consensus.cc:504] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.748059 20642 leader_election.cc:288] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers bb589e2895ff4b32aa1f6276be5f5460 (127.12.155.131:45653), 369ea4021a134458967b955cc6335158 (127.12.155.130:42359)
I20260807 19:48:41.755422 20630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.748576 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:38121 (local address 127.12.155.131:45653)
0807 19:48:41.748905 (+ 329us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.748916 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.749446 (+ 530us) server_negotiation.cc:407] Connection header received
0807 19:48:41.749759 (+ 313us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.749768 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.749871 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.750005 (+ 134us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:41.750679 (+ 674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.751504 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.753460 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.754373 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.754571 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.754666 (+ 95us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.754982 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.755117 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 19:48:41.755475 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.749188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:59485 (local address 127.12.155.130:42359)
0807 19:48:41.749456 (+ 268us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.749462 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.749956 (+ 494us) server_negotiation.cc:407] Connection header received
0807 19:48:41.750252 (+ 296us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.750256 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.750324 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.750430 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:48:41.751003 (+ 573us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.751760 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.753541 (+ 1781us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.754386 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.754573 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.754671 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.755032 (+ 361us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.755172 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:48:41.755517 20646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.748375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:45653 (local address 127.12.155.129:38121)
0807 19:48:41.749291 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:41.749317 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:41.749546 (+ 229us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:41.750087 (+ 541us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:41.750094 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:41.750125 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:41.750505 (+ 380us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.750515 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.751653 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.751660 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.753278 (+ 1618us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.753292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.754625 (+ 1333us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.754632 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.754799 (+ 167us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.754833 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:48:41.754952 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 19:48:41.755094 (+ 142us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":699,"thread_start_us":432,"threads_started":1}
I20260807 19:48:41.755789 20648 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.748478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:42359 (local address 127.12.155.129:59485)
0807 19:48:41.749833 (+ 1355us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:41.749848 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:41.750033 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:41.750459 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:41.750464 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:41.750496 (+ 32us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:48:41.750849 (+ 353us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.750857 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.751916 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.751921 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.753372 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:41.753384 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.754678 (+ 1294us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.754685 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:41.754831 (+ 146us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.754853 (+ 22us) client_negotiation.cc:769] Sending connection context
0807 19:48:41.754989 (+ 136us) client_negotiation.cc:240] Negotiation successful
0807 19:48:41.755115 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1253,"mutex_wait_us":1,"thread_start_us":1006,"threads_started":1}
I20260807 19:48:41.756712 20528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c180e310e4476ab57a71b203c24bb8" candidate_uuid: "b6190060b695454eb3b79dcc15e237dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb589e2895ff4b32aa1f6276be5f5460" is_pre_election: true
I20260807 19:48:41.756799 20317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c180e310e4476ab57a71b203c24bb8" candidate_uuid: "b6190060b695454eb3b79dcc15e237dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369ea4021a134458967b955cc6335158" is_pre_election: true
I20260807 19:48:41.757388 20528 raft_consensus.cc:2454] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6190060b695454eb3b79dcc15e237dd in term 0.
I20260807 19:48:41.757385 20317 raft_consensus.cc:2454] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate b6190060b695454eb3b79dcc15e237dd in term 0.
I20260807 19:48:41.758170 19987 leader_election.cc:302] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 369ea4021a134458967b955cc6335158, b6190060b695454eb3b79dcc15e237dd; no voters:
I20260807 19:48:41.758682 20642 raft_consensus.cc:2781] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:41.758867 20642 raft_consensus.cc:482] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:41.759038 20642 raft_consensus.cc:3037] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:41.761723 20642 raft_consensus.cc:504] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.762539 20642 leader_election.cc:288] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [CANDIDATE]: Term 1 election: Requested vote from peers bb589e2895ff4b32aa1f6276be5f5460 (127.12.155.131:45653), 369ea4021a134458967b955cc6335158 (127.12.155.130:42359)
I20260807 19:48:41.763156 20528 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c180e310e4476ab57a71b203c24bb8" candidate_uuid: "b6190060b695454eb3b79dcc15e237dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "bb589e2895ff4b32aa1f6276be5f5460"
I20260807 19:48:41.763186 20317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d3c180e310e4476ab57a71b203c24bb8" candidate_uuid: "b6190060b695454eb3b79dcc15e237dd" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "369ea4021a134458967b955cc6335158"
I20260807 19:48:41.763435 20528 raft_consensus.cc:3037] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:41.763456 20317 raft_consensus.cc:3037] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:41.766477 20317 raft_consensus.cc:2454] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6190060b695454eb3b79dcc15e237dd in term 1.
I20260807 19:48:41.766494 20528 raft_consensus.cc:2454] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate b6190060b695454eb3b79dcc15e237dd in term 1.
I20260807 19:48:41.766954 19987 leader_election.cc:302] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 369ea4021a134458967b955cc6335158, b6190060b695454eb3b79dcc15e237dd, bb589e2895ff4b32aa1f6276be5f5460; no voters:
I20260807 19:48:41.767331 20642 raft_consensus.cc:2781] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:41.767885 20642 raft_consensus.cc:686] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 1 LEADER]: Becoming Leader. State: Replica: b6190060b695454eb3b79dcc15e237dd, State: Running, Role: LEADER
I20260807 19:48:41.768501 20642 consensus_queue.cc:237] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } }
I20260807 19:48:41.774266 19851 catalog_manager.cc:5495] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd reported cstate change: term changed from 0 to 1, leader changed from <none> to b6190060b695454eb3b79dcc15e237dd (127.12.155.129). New cstate: current_term: 1 leader_uuid: "b6190060b695454eb3b79dcc15e237dd" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "b6190060b695454eb3b79dcc15e237dd" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40129 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 } health_report { overall_health: UNKNOWN } } }
W20260807 19:48:41.792143 20397 tablet.cc:2369] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:41.837982 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.831572 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52990 (local address 127.12.155.129:40129)
0807 19:48:41.831917 (+ 345us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.831924 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.831948 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:48:41.832230 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.832237 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.832337 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.832522 (+ 185us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:48:41.832961 (+ 439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.833764 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.835268 (+ 1504us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.835879 (+ 611us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.836039 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.836601 (+ 562us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:48:41.837303 (+ 702us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:48:41.837499 (+ 196us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.837561 (+ 62us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.837658 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260807 19:48:41.848346 20317 raft_consensus.cc:1261] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 1 FOLLOWER]: Refusing update from remote peer b6190060b695454eb3b79dcc15e237dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:41.848346 20528 raft_consensus.cc:1261] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 1 FOLLOWER]: Refusing update from remote peer b6190060b695454eb3b79dcc15e237dd: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:41.849517 20650 consensus_queue.cc:1035] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "369ea4021a134458967b955cc6335158" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42359 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:41.849921 20642 consensus_queue.cc:1035] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [LEADER]: Connected to new peer: Peer: permanent_uuid: "bb589e2895ff4b32aa1f6276be5f5460" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 45653 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:41.862213 20656 mvcc.cc:205] Tried to move back new op lower bound from 7315997171077926912 to 7315997170768379904. Current Snapshot: MvccSnapshot[applied={T|T < 7315997171077926912}]
I20260807 19:48:41.867863 20658 mvcc.cc:205] Tried to move back new op lower bound from 7315997171077926912 to 7315997170768379904. Current Snapshot: MvccSnapshot[applied={T|T < 7315997171077926912}]
I20260807 19:48:41.871892 20657 mvcc.cc:205] Tried to move back new op lower bound from 7315997171077926912 to 7315997170768379904. Current Snapshot: MvccSnapshot[applied={T|T < 7315997171077926912}]
I20260807 19:48:41.881553 19852 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:41.881909 19852 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53108:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:41.886260 19852 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 2bb54873ddfc47febd341eae0d5fdea5: Sending DeleteTablet for 3 replicas of tablet d3c180e310e4476ab57a71b203c24bb8
I20260807 19:48:41.887765 20497 tablet_service.cc:1514] Processing DeleteTablet for tablet d3c180e310e4476ab57a71b203c24bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:41 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:49948
I20260807 19:48:41.887856 20070 tablet_service.cc:1514] Processing DeleteTablet for tablet d3c180e310e4476ab57a71b203c24bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:41 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:52980
I20260807 19:48:41.887923 20289 tablet_service.cc:1514] Processing DeleteTablet for tablet d3c180e310e4476ab57a71b203c24bb8 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:41 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:52638
I20260807 19:48:41.893482 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 19956
I20260807 19:48:41.903568 20674 tablet_replica.cc:330] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: stopping tablet replica
I20260807 19:48:41.904440 20674 raft_consensus.cc:2229] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:41.905308 20674 raft_consensus.cc:2258] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:41.907327 20671 tablet_replica.cc:330] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: stopping tablet replica
I20260807 19:48:41.908061 20672 tablet_replica.cc:330] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: stopping tablet replica
I20260807 19:48:41.908593 20672 raft_consensus.cc:2229] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:41.908738 20671 raft_consensus.cc:2229] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:41.909372 20672 raft_consensus.cc:2258] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:41.909405 20674 ts_tablet_manager.cc:1905] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:41.909901 20671 raft_consensus.cc:2258] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:41.912166 20672 ts_tablet_manager.cc:1905] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:41.912180 20671 ts_tablet_manager.cc:1905] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 19:48:41 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:41.920477 20672 ts_tablet_manager.cc:1918] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:41.920534 20671 ts_tablet_manager.cc:1918] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:41.920784 20671 log.cc:1196] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/d3c180e310e4476ab57a71b203c24bb8
I20260807 19:48:41.920810 20672 log.cc:1196] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/d3c180e310e4476ab57a71b203c24bb8
I20260807 19:48:41.921592 20671 ts_tablet_manager.cc:1939] T d3c180e310e4476ab57a71b203c24bb8 P b6190060b695454eb3b79dcc15e237dd: Deleting consensus metadata
I20260807 19:48:41.921864 20672 ts_tablet_manager.cc:1939] T d3c180e310e4476ab57a71b203c24bb8 P bb589e2895ff4b32aa1f6276be5f5460: Deleting consensus metadata
I20260807 19:48:41.924415 19826 catalog_manager.cc:4841] TS bb589e2895ff4b32aa1f6276be5f5460 (127.12.155.131:45653): tablet d3c180e310e4476ab57a71b203c24bb8 (table test-table [id=2289d666fb3a4797a47c82aad20fd7c0]) successfully deleted
I20260807 19:48:41.924372 19828 catalog_manager.cc:4841] TS b6190060b695454eb3b79dcc15e237dd (127.12.155.129:40129): tablet d3c180e310e4476ab57a71b203c24bb8 (table test-table [id=2289d666fb3a4797a47c82aad20fd7c0]) successfully deleted
I20260807 19:48:41.926620 20674 ts_tablet_manager.cc:1918] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:41.926860 20674 log.cc:1196] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableWebUI.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/d3c180e310e4476ab57a71b203c24bb8
I20260807 19:48:41.927493 20674 ts_tablet_manager.cc:1939] T d3c180e310e4476ab57a71b203c24bb8 P 369ea4021a134458967b955cc6335158: Deleting consensus metadata
I20260807 19:48:41.928771 20626 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:41.896205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53002 (local address 127.12.155.129:40129)
0807 19:48:41.896495 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:41.896505 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:41.906479 (+ 9974us) server_negotiation.cc:407] Connection header received
0807 19:48:41.906770 (+ 291us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:41.906780 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:41.906933 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:41.907066 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:41.909244 (+ 2178us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.910671 (+ 1427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.912636 (+ 1965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:41.913366 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:41.913468 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:41.920243 (+ 6775us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:41.920263 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:41.920290 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:41.920354 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:41.925208 (+ 4854us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:41.926127 (+ 919us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:41.926138 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:41.926141 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:41.926308 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:41.926732 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:41.926743 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:41.926758 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:41.927274 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:41.927639 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:41.928004 (+ 365us) server_negotiation.cc:299] Negotiation successful
0807 19:48:41.928288 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 19:48:41.929598 20174 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:41.929926 19828 catalog_manager.cc:4841] TS 369ea4021a134458967b955cc6335158 (127.12.155.130:42359): tablet d3c180e310e4476ab57a71b203c24bb8 (table test-table [id=2289d666fb3a4797a47c82aad20fd7c0]) successfully deleted
I20260807 19:48:42.042243 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 19956
I20260807 19:48:42.080137 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 20193
Aug 07 19:48:42 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:42.098992 20632 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:42.081318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52650 (local address 127.12.155.130:42359)
0807 19:48:42.081532 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:42.081537 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:42.081561 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:48:42.081701 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:42.081706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:42.081893 (+ 187us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:42.081994 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:42.083573 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:42.084494 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:42.085863 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:42.086535 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:42.086644 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:42.091783 (+ 5139us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:42.091809 (+ 26us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:42.091836 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:42.091890 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:42.095604 (+ 3714us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:42.096631 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:42.096640 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:42.096643 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:42.096814 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:42.097293 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:42.097297 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:42.097299 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:42.097759 (+ 460us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:42.098013 (+ 254us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:42.098464 (+ 451us) server_negotiation.cc:299] Negotiation successful
0807 19:48:42.098668 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:48:42.099938 20386 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:42.201943 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 20193
I20260807 19:48:42.235343 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 20406
Aug 07 19:48:42 dist-test-slave-2p8l krb5kdc[19778](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132118, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:42.253774 20630 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:42.236493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49954 (local address 127.12.155.131:45653)
0807 19:48:42.236741 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:42.236748 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:42.236774 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:48:42.237005 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:42.237011 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:42.237093 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:42.237236 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:42.238830 (+ 1594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:42.239660 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:42.241069 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:42.241537 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:42.241686 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:42.246898 (+ 5212us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:42.246927 (+ 29us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:42.246952 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:42.246997 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:42.250448 (+ 3451us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:42.251260 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:42.251270 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:42.251273 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:42.251449 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:42.251887 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:42.251892 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:42.251898 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:42.252385 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:42.252754 (+ 369us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:42.253106 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 19:48:42.253371 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 19:48:42.254765 20598 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:42.353291 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 20406
I20260807 19:48:42.396440 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 19804
I20260807 19:48:42.397946 19900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:42.525941 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 19804
2026-08-07T19:48:42Z chronyd exiting
[ OK ] SecurityITest.TestDisableWebUI (5436 ms)
[ RUN ] SecurityITest.TestDisableAuthenticationEncryption
2026-08-07T19:48:42Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:42Z Disabled control of system clock
I20260807 19:48:42.627435 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:35673
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:44677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:35673
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 19:48:43.042443 20690 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:43.042819 20690 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:43.042989 20690 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:43.054246 20690 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:43.054539 20690 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:43.054626 20690 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:43.054716 20690 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:43.054782 20690 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:43.066864 20690 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:35673
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:35673
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:43.068686 20690 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:43.071071 20690 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:43.085714 20699 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:43.085620 20700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:43.086299 20702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:43.087297 20690 server_base.cc:1034] running on GCE node
I20260807 19:48:43.088320 20690 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:43.090324 20690 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:43.091547 20690 hybrid_clock.cc:648] HybridClock initialized: now 1786132123091486 us; error 56 us; skew 500 ppm
I20260807 19:48:43.091982 20690 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:43.095115 20690 webserver.cc:460] Webserver started at http://127.12.155.190:42531/ using document root <none> and password file <none>
I20260807 19:48:43.096101 20690 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:43.096212 20690 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:43.096709 20690 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:43.100714 20690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "5332204eb48c4521a5d1c3802033146c"
format_stamp: "Formatted at 2026-08-07 19:48:43 on dist-test-slave-2p8l"
server_key: "388015511a5ab46c6aa4d995a97e7fef"
server_key_iv: "a40f64160d9d7b690d327b5e56a57b4b"
server_key_version: "encryptionkey@0"
I20260807 19:48:43.101780 20690 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "5332204eb48c4521a5d1c3802033146c"
format_stamp: "Formatted at 2026-08-07 19:48:43 on dist-test-slave-2p8l"
server_key: "388015511a5ab46c6aa4d995a97e7fef"
server_key_iv: "a40f64160d9d7b690d327b5e56a57b4b"
server_key_version: "encryptionkey@0"
I20260807 19:48:43.108636 20690 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:43.113384 20712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:43.115370 20690 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 19:48:43.115610 20690 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "5332204eb48c4521a5d1c3802033146c"
format_stamp: "Formatted at 2026-08-07 19:48:43 on dist-test-slave-2p8l"
server_key: "388015511a5ab46c6aa4d995a97e7fef"
server_key_iv: "a40f64160d9d7b690d327b5e56a57b4b"
server_key_version: "encryptionkey@0"
I20260807 19:48:43.115931 20690 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:43.123970 20690 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:43.125174 20690 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:43.125607 20690 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:43.149741 20690 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:35673
I20260807 19:48:43.149762 20799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:35673 every 8 connection(s)
I20260807 19:48:43.151785 20690 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:43.156980 20801 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:43.159271 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 20690
I20260807 19:48:43.159540 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:43.160406 12910 external_mini_cluster.cc:1428] Setting key 12aa3f7b30709e46408ef3bf835455c5
I20260807 19:48:43.175908 20801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c: Bootstrap starting.
I20260807 19:48:43.176425 20809 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:43.163185 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48542 (local address 127.12.155.190:35673)
0807 19:48:43.169032 (+ 5847us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:43.169049 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:43.169113 (+ 64us) server_negotiation.cc:407] Connection header received
0807 19:48:43.171447 (+ 2334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:43.171482 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:43.172090 (+ 608us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:43.172651 (+ 561us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:43.174117 (+ 1466us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:43.174131 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:43.174155 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:43.174183 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:43.174255 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:43.174285 (+ 30us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:43.174644 (+ 359us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:43.174817 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 19:48:43.175148 (+ 331us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5195,"thread_start_us":4838,"threads_started":1}
I20260807 19:48:43.180459 20801 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:43.181726 20801 log.cc:824] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:43.185421 20801 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c: No bootstrap required, opened a new log
I20260807 19:48:43.193796 20801 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5332204eb48c4521a5d1c3802033146c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35673 } }
I20260807 19:48:43.194326 20801 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:43.194450 20801 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5332204eb48c4521a5d1c3802033146c, State: Initialized, Role: FOLLOWER
I20260807 19:48:43.195245 20801 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5332204eb48c4521a5d1c3802033146c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35673 } }
I20260807 19:48:43.195524 20801 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:43.195669 20801 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:43.195866 20801 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:43.198366 20801 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5332204eb48c4521a5d1c3802033146c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35673 } }
I20260807 19:48:43.198978 20801 leader_election.cc:302] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5332204eb48c4521a5d1c3802033146c; no voters:
I20260807 19:48:43.199679 20801 leader_election.cc:288] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:43.199921 20815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:43.200897 20815 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [term 1 LEADER]: Becoming Leader. State: Replica: 5332204eb48c4521a5d1c3802033146c, State: Running, Role: LEADER
I20260807 19:48:43.201635 20815 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5332204eb48c4521a5d1c3802033146c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35673 } }
I20260807 19:48:43.202482 20801 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:43.205097 20816 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5332204eb48c4521a5d1c3802033146c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5332204eb48c4521a5d1c3802033146c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35673 } } }
I20260807 19:48:43.205215 20817 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5332204eb48c4521a5d1c3802033146c. Latest consensus state: current_term: 1 leader_uuid: "5332204eb48c4521a5d1c3802033146c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5332204eb48c4521a5d1c3802033146c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35673 } } }
I20260807 19:48:43.205565 20817 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:43.205569 20816 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:43.209416 20827 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:43.215657 20827 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:43.227793 20827 catalog_manager.cc:1347] Generated new cluster ID: dd8e66a331114195a4a371f6816a59ac
I20260807 19:48:43.227998 20827 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:43.243613 20827 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:43.244264 20827 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:43.263034 20827 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c: Generated new TSK 0
I20260807 19:48:43.264518 20827 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:48:43.283221 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35673
--builtin_ntp_servers=127.12.155.148:44677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
W20260807 19:48:43.725047 20851 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:43.725425 20851 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:43.725536 20851 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:43.734014 20851 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:43.734211 20851 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:43.734359 20851 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:43.745175 20851 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:43.747108 20851 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:43.749549 20851 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:43.766536 20859 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:43.766574 20861 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:43.766624 20857 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:43.767753 20851 server_base.cc:1034] running on GCE node
I20260807 19:48:43.768498 20851 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:43.769750 20851 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:43.770975 20851 hybrid_clock.cc:648] HybridClock initialized: now 1786132123770867 us; error 84 us; skew 500 ppm
I20260807 19:48:43.771380 20851 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:43.774482 20851 webserver.cc:460] Webserver started at http://127.12.155.129:39773/ using document root <none> and password file <none>
I20260807 19:48:43.775417 20851 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:43.775553 20851 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:43.775986 20851 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:43.779803 20851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "a13c51bf0fdf43f2afa22795528712c9"
format_stamp: "Formatted at 2026-08-07 19:48:43 on dist-test-slave-2p8l"
server_key: "04cc38b283cafd4a74762255b52dc5a5"
server_key_iv: "2044b63952d7fe8956c3640ddc282eba"
server_key_version: "encryptionkey@0"
I20260807 19:48:43.780802 20851 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "a13c51bf0fdf43f2afa22795528712c9"
format_stamp: "Formatted at 2026-08-07 19:48:43 on dist-test-slave-2p8l"
server_key: "04cc38b283cafd4a74762255b52dc5a5"
server_key_iv: "2044b63952d7fe8956c3640ddc282eba"
server_key_version: "encryptionkey@0"
I20260807 19:48:43.788204 20851 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 19:48:43.793231 20870 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:43.795099 20851 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:48:43.795341 20851 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "a13c51bf0fdf43f2afa22795528712c9"
format_stamp: "Formatted at 2026-08-07 19:48:43 on dist-test-slave-2p8l"
server_key: "04cc38b283cafd4a74762255b52dc5a5"
server_key_iv: "2044b63952d7fe8956c3640ddc282eba"
server_key_version: "encryptionkey@0"
I20260807 19:48:43.795629 20851 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:43.802822 20851 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:43.804036 20851 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:43.804373 20851 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:43.805625 20851 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:43.807667 20851 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:43.807813 20851 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:43.807963 20851 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:43.808061 20851 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:43.848466 20851 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:40883
I20260807 19:48:43.848531 21078 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:40883 every 8 connection(s)
I20260807 19:48:43.850191 20851 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:43.851738 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 20851
I20260807 19:48:43.851986 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:43.852770 12910 external_mini_cluster.cc:1428] Setting key 2ee61298a9e0d7605e5c087f9f07ef8f
I20260807 19:48:43.856819 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35673
--builtin_ntp_servers=127.12.155.148:44677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 19:48:43.864743 21083 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:43.854782 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35673 (local address 127.12.155.129:40997)
0807 19:48:43.856179 (+ 1397us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:43.856248 (+ 69us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:43.859173 (+ 2925us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:43.860112 (+ 939us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:43.860128 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:43.860302 (+ 174us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:43.861432 (+ 1130us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:43.861436 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:43.861518 (+ 82us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:43.861672 (+ 154us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:43.862320 (+ 648us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:43.862337 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:43.862351 (+ 14us) client_negotiation.cc:769] Sending connection context
0807 19:48:43.862672 (+ 321us) client_negotiation.cc:240] Negotiation successful
0807 19:48:43.863034 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":404,"threads_started":1}
I20260807 19:48:43.865877 21082 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:43.853800 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:40997 (local address 127.12.155.190:35673)
0807 19:48:43.854545 (+ 745us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:43.854553 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:43.856395 (+ 1842us) server_negotiation.cc:407] Connection header received
0807 19:48:43.859552 (+ 3157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:43.859558 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:43.859646 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:43.859768 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:43.861922 (+ 2154us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:43.861929 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:43.861948 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:43.861981 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:43.862080 (+ 99us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:43.862102 (+ 22us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:43.862256 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:43.865320 (+ 3064us) server_negotiation.cc:299] Negotiation successful
0807 19:48:43.865418 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":556,"thread_start_us":1093,"threads_started":1}
I20260807 19:48:43.867615 21080 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35673
I20260807 19:48:43.868073 21080 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:43.869160 21080 heartbeater.cc:511] Master 127.12.155.190:35673 requested a full tablet report, sending...
I20260807 19:48:43.872628 20740 ts_manager.cc:194] Registered new tserver with Master: a13c51bf0fdf43f2afa22795528712c9 (127.12.155.129:40883)
W20260807 19:48:44.271664 21084 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:44.272050 21084 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:44.272152 21084 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:44.280064 21084 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:44.280210 21084 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:44.280339 21084 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:44.290647 21084 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:44.292507 21084 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:44.294966 21084 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:44.310753 21095 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:44.310835 21093 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:44.310812 21092 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:44.312146 21084 server_base.cc:1034] running on GCE node
I20260807 19:48:44.312839 21084 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:44.313951 21084 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:44.315209 21084 hybrid_clock.cc:648] HybridClock initialized: now 1786132124315150 us; error 56 us; skew 500 ppm
I20260807 19:48:44.315608 21084 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:44.318600 21084 webserver.cc:460] Webserver started at http://127.12.155.130:41241/ using document root <none> and password file <none>
I20260807 19:48:44.319515 21084 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:44.319664 21084 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:44.320063 21084 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:44.323848 21084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "9bd9ed715f384013b58896ef9d8a4c8e"
format_stamp: "Formatted at 2026-08-07 19:48:44 on dist-test-slave-2p8l"
server_key: "30c2621a8c8b271d69f1d678a2bf86ce"
server_key_iv: "0475d5e0df0420888041331aa7bb113e"
server_key_version: "encryptionkey@0"
I20260807 19:48:44.324863 21084 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "9bd9ed715f384013b58896ef9d8a4c8e"
format_stamp: "Formatted at 2026-08-07 19:48:44 on dist-test-slave-2p8l"
server_key: "30c2621a8c8b271d69f1d678a2bf86ce"
server_key_iv: "0475d5e0df0420888041331aa7bb113e"
server_key_version: "encryptionkey@0"
I20260807 19:48:44.331382 21084 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.008s sys 0.000s
I20260807 19:48:44.335592 21101 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:44.337190 21084 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:48:44.337395 21084 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "9bd9ed715f384013b58896ef9d8a4c8e"
format_stamp: "Formatted at 2026-08-07 19:48:44 on dist-test-slave-2p8l"
server_key: "30c2621a8c8b271d69f1d678a2bf86ce"
server_key_iv: "0475d5e0df0420888041331aa7bb113e"
server_key_version: "encryptionkey@0"
I20260807 19:48:44.337702 21084 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:44.344746 21084 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:44.345706 21084 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:44.346028 21084 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:44.347225 21084 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:44.348924 21084 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:44.349059 21084 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:44.349207 21084 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:44.349303 21084 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:44.388306 21084 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:33827
I20260807 19:48:44.388437 21295 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:33827 every 8 connection(s)
I20260807 19:48:44.389998 21084 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:44.393801 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 21084
I20260807 19:48:44.394008 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:44.394688 12910 external_mini_cluster.cc:1428] Setting key 1ae84830a6a10d3743dbfc528895ace4
I20260807 19:48:44.398802 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35673
--builtin_ntp_servers=127.12.155.148:44677
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled
--rpc_encryption=disabled with env {}
I20260807 19:48:44.401037 21299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:44.393327 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:47799 (local address 127.12.155.190:35673)
0807 19:48:44.393952 (+ 625us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:44.393963 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:44.395621 (+ 1658us) server_negotiation.cc:407] Connection header received
0807 19:48:44.397976 (+ 2355us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:44.397980 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:44.398053 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:44.398240 (+ 187us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:44.400013 (+ 1773us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:44.400018 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:44.400023 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:44.400042 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:44.400099 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:44.400113 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:44.400249 (+ 136us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:44.400490 (+ 241us) server_negotiation.cc:299] Negotiation successful
0807 19:48:44.400557 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":455,"thread_start_us":288,"threads_started":1}
I20260807 19:48:44.402522 21300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:44.394102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35673 (local address 127.12.155.130:47799)
0807 19:48:44.395413 (+ 1311us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:44.395476 (+ 63us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:44.397627 (+ 2151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:44.398544 (+ 917us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:44.398560 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:44.398710 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:44.399607 (+ 897us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:44.399614 (+ 7us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:44.399683 (+ 69us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:44.399825 (+ 142us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:44.400224 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:44.400248 (+ 24us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:44.400259 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:48:44.400595 (+ 336us) client_negotiation.cc:240] Negotiation successful
0807 19:48:44.400938 (+ 343us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":342,"threads_started":1}
I20260807 19:48:44.404261 21297 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35673
I20260807 19:48:44.404665 21297 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:44.405483 21297 heartbeater.cc:511] Master 127.12.155.190:35673 requested a full tablet report, sending...
I20260807 19:48:44.407460 20740 ts_manager.cc:194] Registered new tserver with Master: 9bd9ed715f384013b58896ef9d8a4c8e (127.12.155.130:33827)
W20260807 19:48:44.824793 21301 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:44.825172 21301 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:44.825359 21301 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:44.833830 21301 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:44.834008 21301 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:44.834278 21301 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:44.845418 21301 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44677
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35673
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:44.847496 21301 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:44.850312 21301 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:44.867352 21313 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:44.867308 21312 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:44.867424 21318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:44.868810 21301 server_base.cc:1034] running on GCE node
I20260807 19:48:44.869755 21301 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:44.871351 21301 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:44.872617 21301 hybrid_clock.cc:648] HybridClock initialized: now 1786132124872542 us; error 65 us; skew 500 ppm
I20260807 19:48:44.872997 21301 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:44.875859 21301 webserver.cc:460] Webserver started at http://127.12.155.131:45987/ using document root <none> and password file <none>
I20260807 19:48:44.876855 21301 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:44.877000 21301 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:44.876988 21080 heartbeater.cc:503] Master 127.12.155.190:35673 was elected leader, sending a full tablet report...
I20260807 19:48:44.877476 21301 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:44.881325 21301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "7a944ec03e1a46a28461437ed57c51b0"
format_stamp: "Formatted at 2026-08-07 19:48:44 on dist-test-slave-2p8l"
server_key: "554e4e5b62b750c51e58a0579b72efc4"
server_key_iv: "10760eedda98378231b55719cb159a96"
server_key_version: "encryptionkey@0"
I20260807 19:48:44.882360 21301 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "7a944ec03e1a46a28461437ed57c51b0"
format_stamp: "Formatted at 2026-08-07 19:48:44 on dist-test-slave-2p8l"
server_key: "554e4e5b62b750c51e58a0579b72efc4"
server_key_iv: "10760eedda98378231b55719cb159a96"
server_key_version: "encryptionkey@0"
I20260807 19:48:44.888907 21301 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.004s
I20260807 19:48:44.893105 21327 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:44.894892 21301 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:44.895092 21301 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "7a944ec03e1a46a28461437ed57c51b0"
format_stamp: "Formatted at 2026-08-07 19:48:44 on dist-test-slave-2p8l"
server_key: "554e4e5b62b750c51e58a0579b72efc4"
server_key_iv: "10760eedda98378231b55719cb159a96"
server_key_version: "encryptionkey@0"
I20260807 19:48:44.895349 21301 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:44.902779 21301 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:44.903828 21301 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:44.904138 21301 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:44.905261 21301 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:44.907076 21301 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:44.907217 21301 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:44.907354 21301 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:44.907454 21301 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:44.946923 21301 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:40885
I20260807 19:48:44.946974 21532 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:40885 every 8 connection(s)
I20260807 19:48:44.948678 21301 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:44.952169 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 21301
I20260807 19:48:44.952404 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:44.953060 12910 external_mini_cluster.cc:1428] Setting key 7f646471489d7aef34728a7db158c5ee
I20260807 19:48:44.959096 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:44.952041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:39899 (local address 127.12.155.190:35673)
0807 19:48:44.952737 (+ 696us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:44.952744 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:44.954394 (+ 1650us) server_negotiation.cc:407] Connection header received
0807 19:48:44.956394 (+ 2000us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:44.956400 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:44.956501 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:44.956667 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:44.958314 (+ 1647us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:44.958320 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:44.958324 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:44.958343 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:44.958395 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:44.958407 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:44.958516 (+ 109us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:44.958709 (+ 193us) server_negotiation.cc:299] Negotiation successful
0807 19:48:44.958772 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":503,"thread_start_us":325,"threads_started":1}
I20260807 19:48:44.960371 21537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:44.952867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35673 (local address 127.12.155.131:39899)
0807 19:48:44.954212 (+ 1345us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:44.954269 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:44.956092 (+ 1823us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:44.956964 (+ 872us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:44.956973 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:44.957095 (+ 122us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:44.957932 (+ 837us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:44.957934 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:44.957982 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:44.958153 (+ 171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:44.958507 (+ 354us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:44.958516 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:44.958522 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 19:48:44.958776 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 19:48:44.959058 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":401,"threads_started":1}
I20260807 19:48:44.961907 21533 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35673
I20260807 19:48:44.962381 21533 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:44.963189 21533 heartbeater.cc:511] Master 127.12.155.190:35673 requested a full tablet report, sending...
I20260807 19:48:44.965073 20740 ts_manager.cc:194] Registered new tserver with Master: 7a944ec03e1a46a28461437ed57c51b0 (127.12.155.131:40885)
I20260807 19:48:44.969534 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:48:44.978255 21536 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:44.975209 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48548 (local address 127.12.155.190:35673)
0807 19:48:44.975421 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:44.975426 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:44.976022 (+ 596us) server_negotiation.cc:407] Connection header received
0807 19:48:44.976188 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:44.976193 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:44.976269 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:44.976372 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:44.977523 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:44.977529 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:44.977533 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:44.977552 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:44.977596 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:44.977611 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:44.977741 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:44.977787 (+ 46us) server_negotiation.cc:299] Negotiation successful
0807 19:48:44.977854 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:48:44.983566 20740 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48548:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:48:44.991513 20740 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:48:45.025949 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.007659 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39242 (local address 127.12.155.130:33827)
0807 19:48:45.021203 (+ 13544us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.021217 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.021285 (+ 68us) server_negotiation.cc:407] Connection header received
0807 19:48:45.021395 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.021403 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.021800 (+ 397us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.023155 (+ 1355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.024506 (+ 1351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.024514 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.024527 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.024547 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.024595 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.024611 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.024790 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.025390 (+ 600us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.025525 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13268,"thread_start_us":14284,"threads_started":1}
I20260807 19:48:45.026145 21559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.007510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:33827 (local address 127.0.0.1:39242)
0807 19:48:45.020148 (+ 12638us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:45.020215 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:45.020460 (+ 245us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:45.022408 (+ 1948us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:45.022420 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:45.022552 (+ 132us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:45.023600 (+ 1048us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:45.023603 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:45.023633 (+ 30us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:45.023721 (+ 88us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:45.024738 (+ 1017us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:45.024759 (+ 21us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:45.024774 (+ 15us) client_negotiation.cc:769] Sending connection context
0807 19:48:45.025397 (+ 623us) client_negotiation.cc:240] Negotiation successful
0807 19:48:45.025509 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10494,"spinlock_wait_cycles":11392,"thread_start_us":10568,"threads_started":1}
I20260807 19:48:45.026598 21564 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.021648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:40885 (local address 127.0.0.1:48166)
0807 19:48:45.022576 (+ 928us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:45.022595 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:45.022728 (+ 133us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:45.024369 (+ 1641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:45.024379 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:45.024404 (+ 25us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:45.025230 (+ 826us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:45.025233 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:45.025245 (+ 12us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:45.025281 (+ 36us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:45.025890 (+ 609us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:45.025895 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:45.025901 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 19:48:45.026094 (+ 193us) client_negotiation.cc:240] Negotiation successful
0807 19:48:45.026157 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":800,"thread_start_us":616,"threads_started":1}
I20260807 19:48:45.027417 21563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.019961 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48166 (local address 127.12.155.131:40885)
0807 19:48:45.021187 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.021198 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.022754 (+ 1556us) server_negotiation.cc:407] Connection header received
0807 19:48:45.022865 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.022873 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.023084 (+ 211us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.023232 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.025482 (+ 2250us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.025495 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.025509 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.025532 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.025606 (+ 74us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.025630 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.025824 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.026841 (+ 1017us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.026960 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1017,"thread_start_us":1264,"threads_started":1}
I20260807 19:48:45.028213 21562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.008159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50690 (local address 127.12.155.129:40883)
0807 19:48:45.022188 (+ 14029us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.022201 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.022244 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:48:45.022337 (+ 93us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.022345 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.022608 (+ 263us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.022835 (+ 227us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.026913 (+ 4078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.026927 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.026940 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.026966 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.027038 (+ 72us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.027061 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.027264 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.027335 (+ 71us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.027456 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13750,"thread_start_us":13547,"threads_started":1}
I20260807 19:48:45.028754 21558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.007592 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:40883 (local address 127.0.0.1:50690)
0807 19:48:45.020147 (+ 12555us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:45.020214 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:45.020455 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:45.024274 (+ 3819us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:45.024279 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:45.024305 (+ 26us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:45.025140 (+ 835us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:45.025145 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:45.025169 (+ 24us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:45.025232 (+ 63us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:45.027193 (+ 1961us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:45.027199 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:45.027207 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:48:45.027353 (+ 146us) client_negotiation.cc:240] Negotiation successful
0807 19:48:45.027413 (+ 60us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12170,"spinlock_wait_cycles":55424,"thread_start_us":11994,"threads_started":1}
I20260807 19:48:45.031739 21414 tablet_service.cc:1467] Processing CreateTablet for tablet 88122c515d714f88b17f2dba9f5d1a95 (DEFAULT_TABLE table=test-table [id=1a0068c95d074509adb7ebe571f329fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:45.031445 21183 tablet_service.cc:1467] Processing CreateTablet for tablet 88122c515d714f88b17f2dba9f5d1a95 (DEFAULT_TABLE table=test-table [id=1a0068c95d074509adb7ebe571f329fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:45.032958 20955 tablet_service.cc:1467] Processing CreateTablet for tablet 88122c515d714f88b17f2dba9f5d1a95 (DEFAULT_TABLE table=test-table [id=1a0068c95d074509adb7ebe571f329fb]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:48:45.033620 21414 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88122c515d714f88b17f2dba9f5d1a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:45.033600 21183 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88122c515d714f88b17f2dba9f5d1a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:45.034543 20955 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 88122c515d714f88b17f2dba9f5d1a95. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:45.053218 21567 tablet_bootstrap.cc:492] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Bootstrap starting.
I20260807 19:48:45.056690 21565 tablet_bootstrap.cc:492] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Bootstrap starting.
I20260807 19:48:45.062824 21565 tablet_bootstrap.cc:654] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:45.063124 21567 tablet_bootstrap.cc:654] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:45.064436 21565 log.cc:824] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:45.065102 21567 log.cc:824] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:45.066967 21566 tablet_bootstrap.cc:492] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Bootstrap starting.
I20260807 19:48:45.071030 21566 tablet_bootstrap.cc:654] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:45.072527 21566 log.cc:824] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:45.073966 21567 tablet_bootstrap.cc:492] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: No bootstrap required, opened a new log
I20260807 19:48:45.073963 21565 tablet_bootstrap.cc:492] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: No bootstrap required, opened a new log
I20260807 19:48:45.074359 21567 ts_tablet_manager.cc:1397] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.000s
I20260807 19:48:45.074369 21565 ts_tablet_manager.cc:1397] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.004s
I20260807 19:48:45.075929 21566 tablet_bootstrap.cc:492] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: No bootstrap required, opened a new log
I20260807 19:48:45.076254 21566 ts_tablet_manager.cc:1397] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.003s
I20260807 19:48:45.085234 21566 raft_consensus.cc:348] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.085758 21566 raft_consensus.cc:374] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:45.085879 21566 raft_consensus.cc:729] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a13c51bf0fdf43f2afa22795528712c9, State: Initialized, Role: FOLLOWER
I20260807 19:48:45.086480 21565 raft_consensus.cc:348] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.086481 21567 raft_consensus.cc:348] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.086973 21565 raft_consensus.cc:374] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:45.086973 21567 raft_consensus.cc:374] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:45.086747 21566 consensus_queue.cc:260] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.087076 21565 raft_consensus.cc:729] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9bd9ed715f384013b58896ef9d8a4c8e, State: Initialized, Role: FOLLOWER
I20260807 19:48:45.087076 21567 raft_consensus.cc:729] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7a944ec03e1a46a28461437ed57c51b0, State: Initialized, Role: FOLLOWER
I20260807 19:48:45.087754 21565 consensus_queue.cc:260] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.087774 21567 consensus_queue.cc:260] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.089612 21533 heartbeater.cc:503] Master 127.12.155.190:35673 was elected leader, sending a full tablet report...
I20260807 19:48:45.089963 21565 ts_tablet_manager.cc:1428] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260807 19:48:45.090230 21567 ts_tablet_manager.cc:1428] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Time spent starting tablet: real 0.016s user 0.011s sys 0.005s
I20260807 19:48:45.090515 21297 heartbeater.cc:503] Master 127.12.155.190:35673 was elected leader, sending a full tablet report...
I20260807 19:48:45.091820 21566 ts_tablet_manager.cc:1428] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Time spent starting tablet: real 0.015s user 0.013s sys 0.001s
W20260807 19:48:45.103397 21081 tablet.cc:2369] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:48:45.142506 21298 tablet.cc:2369] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:48:45.201020 21535 tablet.cc:2369] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:48:45.264014 21575 raft_consensus.cc:482] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:48:45.264533 21575 raft_consensus.cc:504] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.267010 21575 leader_election.cc:288] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a13c51bf0fdf43f2afa22795528712c9 (127.12.155.129:40883), 7a944ec03e1a46a28461437ed57c51b0 (127.12.155.131:40885)
I20260807 19:48:45.271461 21562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.267456 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:54985 (local address 127.12.155.129:40883)
0807 19:48:45.267763 (+ 307us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.267775 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.268881 (+ 1106us) server_negotiation.cc:407] Connection header received
0807 19:48:45.269051 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.269055 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.269125 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.269287 (+ 162us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.270636 (+ 1349us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.270644 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.270652 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.270680 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.270729 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.270754 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.270876 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.270992 (+ 116us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.271079 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":105}
I20260807 19:48:45.271493 21563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.267983 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:33487 (local address 127.12.155.131:40885)
0807 19:48:45.268206 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.268213 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.268722 (+ 509us) server_negotiation.cc:407] Connection header received
0807 19:48:45.269043 (+ 321us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.269049 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.269114 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.269204 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.270736 (+ 1532us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.270740 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.270743 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.270761 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.270824 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.270841 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.270981 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.271100 (+ 119us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.271177 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:48:45.271840 21577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.267444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:40885 (local address 127.12.155.130:33487)
0807 19:48:45.268554 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:45.268584 (+ 30us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:45.268807 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:45.269285 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:45.269290 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:45.269317 (+ 27us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:45.270480 (+ 1163us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:45.270483 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:45.270497 (+ 14us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:45.270571 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:45.270957 (+ 386us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:45.270963 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:45.270968 (+ 5us) client_negotiation.cc:769] Sending connection context
0807 19:48:45.271166 (+ 198us) client_negotiation.cc:240] Negotiation successful
0807 19:48:45.271220 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":944,"thread_start_us":600,"threads_started":1}
I20260807 19:48:45.272158 21578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.267527 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:40883 (local address 127.12.155.130:54985)
0807 19:48:45.268753 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:45.268769 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:45.268873 (+ 104us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:45.269322 (+ 449us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:45.269326 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:45.269349 (+ 23us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:45.270386 (+ 1037us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:48:45.270388 (+ 2us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:45.270404 (+ 16us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:48:45.270453 (+ 49us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:45.270856 (+ 403us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:45.270863 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:45.270872 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 19:48:45.271140 (+ 268us) client_negotiation.cc:240] Negotiation successful
0807 19:48:45.271201 (+ 61us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1083,"thread_start_us":880,"threads_started":1}
I20260807 19:48:45.273252 20992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88122c515d714f88b17f2dba9f5d1a95" candidate_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13c51bf0fdf43f2afa22795528712c9" is_pre_election: true
I20260807 19:48:45.273267 21448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88122c515d714f88b17f2dba9f5d1a95" candidate_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a944ec03e1a46a28461437ed57c51b0" is_pre_election: true
I20260807 19:48:45.273887 20992 raft_consensus.cc:2454] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd9ed715f384013b58896ef9d8a4c8e in term 0.
I20260807 19:48:45.273885 21448 raft_consensus.cc:2454] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 9bd9ed715f384013b58896ef9d8a4c8e in term 0.
I20260807 19:48:45.274662 21104 leader_election.cc:302] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7a944ec03e1a46a28461437ed57c51b0, 9bd9ed715f384013b58896ef9d8a4c8e; no voters:
I20260807 19:48:45.275133 21575 raft_consensus.cc:2781] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:48:45.275314 21575 raft_consensus.cc:482] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:48:45.275447 21575 raft_consensus.cc:3037] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:45.278271 21575 raft_consensus.cc:504] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.279003 21575 leader_election.cc:288] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [CANDIDATE]: Term 1 election: Requested vote from peers a13c51bf0fdf43f2afa22795528712c9 (127.12.155.129:40883), 7a944ec03e1a46a28461437ed57c51b0 (127.12.155.131:40885)
I20260807 19:48:45.279458 20992 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88122c515d714f88b17f2dba9f5d1a95" candidate_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a13c51bf0fdf43f2afa22795528712c9"
I20260807 19:48:45.279603 21448 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88122c515d714f88b17f2dba9f5d1a95" candidate_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7a944ec03e1a46a28461437ed57c51b0"
I20260807 19:48:45.279695 20992 raft_consensus.cc:3037] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:45.279888 21448 raft_consensus.cc:3037] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:45.282327 20992 raft_consensus.cc:2454] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd9ed715f384013b58896ef9d8a4c8e in term 1.
I20260807 19:48:45.282640 21448 raft_consensus.cc:2454] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 9bd9ed715f384013b58896ef9d8a4c8e in term 1.
I20260807 19:48:45.282778 21105 leader_election.cc:302] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 9bd9ed715f384013b58896ef9d8a4c8e, a13c51bf0fdf43f2afa22795528712c9; no voters:
I20260807 19:48:45.283202 21575 raft_consensus.cc:2781] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:45.283726 21575 raft_consensus.cc:686] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 1 LEADER]: Becoming Leader. State: Replica: 9bd9ed715f384013b58896ef9d8a4c8e, State: Running, Role: LEADER
I20260807 19:48:45.284309 21575 consensus_queue.cc:237] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } }
I20260807 19:48:45.290287 20740 catalog_manager.cc:5495] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e reported cstate change: term changed from 0 to 1, leader changed from <none> to 9bd9ed715f384013b58896ef9d8a4c8e (127.12.155.130). New cstate: current_term: 1 leader_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "9bd9ed715f384013b58896ef9d8a4c8e" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 33827 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 } health_report { overall_health: UNKNOWN } } }
I20260807 19:48:45.327714 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.325136 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39254 (local address 127.12.155.130:33827)
0807 19:48:45.325354 (+ 218us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.325359 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.325397 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:48:45.325658 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.325662 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.325821 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.325936 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.327059 (+ 1123us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.327065 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.327068 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.327089 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.327130 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.327145 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.327273 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.327377 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.327436 (+ 59us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:48:45.338912 20992 raft_consensus.cc:1261] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 1 FOLLOWER]: Refusing update from remote peer 9bd9ed715f384013b58896ef9d8a4c8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:45.338917 21448 raft_consensus.cc:1261] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 1 FOLLOWER]: Refusing update from remote peer 9bd9ed715f384013b58896ef9d8a4c8e: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:48:45.340297 21580 consensus_queue.cc:1035] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "a13c51bf0fdf43f2afa22795528712c9" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 40883 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:45.340808 21575 consensus_queue.cc:1035] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [LEADER]: Connected to new peer: Peer: permanent_uuid: "7a944ec03e1a46a28461437ed57c51b0" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40885 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:48:45.376224 20739 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:45.376655 20739 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:48548:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:48:45.382006 20739 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5332204eb48c4521a5d1c3802033146c: Sending DeleteTablet for 3 replicas of tablet 88122c515d714f88b17f2dba9f5d1a95
I20260807 19:48:45.383885 21414 tablet_service.cc:1514] Processing DeleteTablet for tablet 88122c515d714f88b17f2dba9f5d1a95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:45 UTC) from {username='slave'} at 127.0.0.1:48166
I20260807 19:48:45.383860 20955 tablet_service.cc:1514] Processing DeleteTablet for tablet 88122c515d714f88b17f2dba9f5d1a95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:45 UTC) from {username='slave'} at 127.0.0.1:50690
I20260807 19:48:45.384375 21183 tablet_service.cc:1514] Processing DeleteTablet for tablet 88122c515d714f88b17f2dba9f5d1a95 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:48:45 UTC) from {username='slave'} at 127.0.0.1:39242
I20260807 19:48:45.387168 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 20851
I20260807 19:48:45.396947 21599 tablet_replica.cc:330] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: stopping tablet replica
I20260807 19:48:45.397722 21599 raft_consensus.cc:2229] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:45.400302 21599 raft_consensus.cc:2258] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:45.405972 21599 ts_tablet_manager.cc:1905] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:45.410737 21603 tablet_replica.cc:330] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: stopping tablet replica
I20260807 19:48:45.410971 21602 tablet_replica.cc:330] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: stopping tablet replica
I20260807 19:48:45.411486 21602 raft_consensus.cc:2229] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:48:45.411492 21603 raft_consensus.cc:2229] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:48:45.412128 21602 raft_consensus.cc:2258] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:45.412428 21603 raft_consensus.cc:2258] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:48:45.416024 21603 ts_tablet_manager.cc:1905] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:45.416635 21599 ts_tablet_manager.cc:1918] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:45.416833 21599 log.cc:1196] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/88122c515d714f88b17f2dba9f5d1a95
I20260807 19:48:45.417403 21599 ts_tablet_manager.cc:1939] T 88122c515d714f88b17f2dba9f5d1a95 P a13c51bf0fdf43f2afa22795528712c9: Deleting consensus metadata
I20260807 19:48:45.417897 21562 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.395814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50702 (local address 127.12.155.129:40883)
0807 19:48:45.396113 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.396124 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.413661 (+ 17537us) server_negotiation.cc:407] Connection header received
0807 19:48:45.414147 (+ 486us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.414154 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.414301 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.414410 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.416705 (+ 2295us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.416713 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.416721 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.416752 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.416817 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.416844 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.416992 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.417431 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.417519 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 19:48:45.419389 21073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:45.421403 21602 ts_tablet_manager.cc:1905] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:48:45.424820 21603 ts_tablet_manager.cc:1918] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:45.425045 21603 log.cc:1196] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/88122c515d714f88b17f2dba9f5d1a95
I20260807 19:48:45.425760 21603 ts_tablet_manager.cc:1939] T 88122c515d714f88b17f2dba9f5d1a95 P 9bd9ed715f384013b58896ef9d8a4c8e: Deleting consensus metadata
I20260807 19:48:45.428325 20716 catalog_manager.cc:4841] TS 9bd9ed715f384013b58896ef9d8a4c8e (127.12.155.130:33827): tablet 88122c515d714f88b17f2dba9f5d1a95 (table test-table [id=1a0068c95d074509adb7ebe571f329fb]) successfully deleted
I20260807 19:48:45.429991 21602 ts_tablet_manager.cc:1918] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:48:45.432359 21602 log.cc:1196] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestDisableAuthenticationEncryption.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/88122c515d714f88b17f2dba9f5d1a95
I20260807 19:48:45.433043 21602 ts_tablet_manager.cc:1939] T 88122c515d714f88b17f2dba9f5d1a95 P 7a944ec03e1a46a28461437ed57c51b0: Deleting consensus metadata
I20260807 19:48:45.435182 20716 catalog_manager.cc:4841] TS 7a944ec03e1a46a28461437ed57c51b0 (127.12.155.131:40885): tablet 88122c515d714f88b17f2dba9f5d1a95 (table test-table [id=1a0068c95d074509adb7ebe571f329fb]) successfully deleted
I20260807 19:48:45.542363 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 20851
I20260807 19:48:45.542614 20717 catalog_manager.cc:4841] TS a13c51bf0fdf43f2afa22795528712c9 (127.12.155.129:40883): tablet 88122c515d714f88b17f2dba9f5d1a95 (table test-table [id=1a0068c95d074509adb7ebe571f329fb]) successfully deleted
I20260807 19:48:45.584991 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 21084
I20260807 19:48:45.589116 21561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.586146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39258 (local address 127.12.155.130:33827)
0807 19:48:45.586434 (+ 288us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.586439 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.586618 (+ 179us) server_negotiation.cc:407] Connection header received
0807 19:48:45.586891 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.586896 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.586977 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.587081 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.588278 (+ 1197us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.588283 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.588287 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.588310 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.588361 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.588376 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.588508 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.588648 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.588714 (+ 66us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 19:48:45.590361 21289 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:45.719416 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 21084
I20260807 19:48:45.748682 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 21301
I20260807 19:48:45.755967 21563 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:45.749739 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48168 (local address 127.12.155.131:40885)
0807 19:48:45.749986 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:45.749992 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:45.750169 (+ 177us) server_negotiation.cc:407] Connection header received
0807 19:48:45.750336 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:45.750341 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:45.750463 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:45.750566 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:45.755203 (+ 4637us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:45.755209 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:45.755212 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:45.755232 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:45.755277 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:45.755292 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:45.755422 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:45.755509 (+ 87us) server_negotiation.cc:299] Negotiation successful
0807 19:48:45.755572 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 19:48:45.756868 21523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:45.853076 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 21301
I20260807 19:48:45.890959 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 20690
I20260807 19:48:45.892596 20791 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:46.027276 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 20690
2026-08-07T19:48:46Z chronyd exiting
[ OK ] SecurityITest.TestDisableAuthenticationEncryption (3501 ms)
[ RUN ] SecurityITest.TestJwtMiniCluster
I20260807 19:48:46.088699 12910 mini_oidc.cc:152] Starting JWKS server
I20260807 19:48:46.092443 12910 webserver.cc:460] Webserver started at https://127.0.0.1:39535/ using document root <none> and password file <none>
I20260807 19:48:46.092849 12910 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 19:48:46.093735 12910 webserver.cc:460] Webserver started at http://127.0.0.1:34265/ using document root <none> and password file <none>
2026-08-07T19:48:46Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:46Z Disabled control of system clock
I20260807 19:48:46.139628 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36843
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:43471
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:36843
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39535/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/testchainca.cert with env {}
W20260807 19:48:46.546273 21622 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:46.546797 21622 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:46.546975 21622 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:46.555191 21622 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:46.555375 21622 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:46.555487 21622 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:46.555603 21622 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:46.555682 21622 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:48:46.555785 21622 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:48:46.555858 21622 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:39535/jwks.json
I20260807 19:48:46.567536 21622 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43471
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:36843
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36843
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:39535/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:46.569445 21622 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:46.571237 21622 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:46.585568 21632 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:46.585512 21637 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:46.586108 21631 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:46.587208 21622 server_base.cc:1034] running on GCE node
I20260807 19:48:46.588340 21622 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:46.590342 21622 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:46.591562 21622 hybrid_clock.cc:648] HybridClock initialized: now 1786132126591494 us; error 71 us; skew 500 ppm
I20260807 19:48:46.592001 21622 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:46.595191 21622 webserver.cc:460] Webserver started at http://127.12.155.190:38435/ using document root <none> and password file <none>
I20260807 19:48:46.596097 21622 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:46.596210 21622 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:46.596616 21622 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:46.600407 21622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "886d4015aabd4e08bf94f21ab8b58ecc"
format_stamp: "Formatted at 2026-08-07 19:48:46 on dist-test-slave-2p8l"
server_key: "3bbc64182bb493b22f8e143c3bd331ab"
server_key_iv: "47fd0e888e54c325fd847aaabce65f30"
server_key_version: "encryptionkey@0"
I20260807 19:48:46.601512 21622 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "886d4015aabd4e08bf94f21ab8b58ecc"
format_stamp: "Formatted at 2026-08-07 19:48:46 on dist-test-slave-2p8l"
server_key: "3bbc64182bb493b22f8e143c3bd331ab"
server_key_iv: "47fd0e888e54c325fd847aaabce65f30"
server_key_version: "encryptionkey@0"
I20260807 19:48:46.608686 21622 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.009s sys 0.000s
I20260807 19:48:46.613528 21646 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:46.615552 21622 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:48:46.615777 21622 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "886d4015aabd4e08bf94f21ab8b58ecc"
format_stamp: "Formatted at 2026-08-07 19:48:46 on dist-test-slave-2p8l"
server_key: "3bbc64182bb493b22f8e143c3bd331ab"
server_key_iv: "47fd0e888e54c325fd847aaabce65f30"
server_key_version: "encryptionkey@0"
I20260807 19:48:46.616143 21622 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:46.639771 21622 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:46.640946 21622 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:46.641361 21622 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:46.664320 21622 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:36843
I20260807 19:48:46.664371 21730 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:36843 every 8 connection(s)
I20260807 19:48:46.666218 21622 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:46.670907 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 21622
I20260807 19:48:46.671226 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:46.671701 21731 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:46.672214 12910 external_mini_cluster.cc:1428] Setting key 11964e32019eb99805a43e1611f91b81
I20260807 19:48:46.689126 21731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc: Bootstrap starting.
I20260807 19:48:46.689568 21738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:46.674692 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46268 (local address 127.12.155.190:36843)
0807 19:48:46.676004 (+ 1312us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:46.676020 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:46.676080 (+ 60us) server_negotiation.cc:407] Connection header received
0807 19:48:46.677877 (+ 1797us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:46.677908 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:46.678606 (+ 698us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:46.679029 (+ 423us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:46.679928 (+ 899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:46.681522 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:46.683668 (+ 2146us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:46.684528 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:46.684698 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:46.686383 (+ 1685us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:46.686393 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:46.686413 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:46.687187 (+ 774us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:46.687289 (+ 102us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:46.687320 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:46.687424 (+ 104us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:46.687718 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 19:48:46.688179 (+ 461us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":752,"thread_start_us":502,"threads_started":1}
I20260807 19:48:46.694080 21731 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:46.695050 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:48:46.695789 21731 log.cc:824] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:46.700030 21731 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc: No bootstrap required, opened a new log
I20260807 19:48:46.709069 21731 raft_consensus.cc:348] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36843 } }
I20260807 19:48:46.709617 21731 raft_consensus.cc:374] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:46.709743 21731 raft_consensus.cc:729] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 886d4015aabd4e08bf94f21ab8b58ecc, State: Initialized, Role: FOLLOWER
I20260807 19:48:46.710589 21731 consensus_queue.cc:260] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36843 } }
I20260807 19:48:46.710881 21731 raft_consensus.cc:388] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:46.711041 21731 raft_consensus.cc:482] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:46.711273 21731 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:46.714280 21731 raft_consensus.cc:504] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36843 } }
I20260807 19:48:46.715075 21731 leader_election.cc:302] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 886d4015aabd4e08bf94f21ab8b58ecc; no voters:
I20260807 19:48:46.715893 21731 leader_election.cc:288] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:46.716216 21740 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:46.717192 21740 raft_consensus.cc:686] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [term 1 LEADER]: Becoming Leader. State: Replica: 886d4015aabd4e08bf94f21ab8b58ecc, State: Running, Role: LEADER
I20260807 19:48:46.718003 21740 consensus_queue.cc:237] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36843 } }
I20260807 19:48:46.719079 21731 sys_catalog.cc:564] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:46.723141 21742 sys_catalog.cc:455] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36843 } } }
I20260807 19:48:46.723646 21742 sys_catalog.cc:458] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:46.723942 21743 sys_catalog.cc:455] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 886d4015aabd4e08bf94f21ab8b58ecc. Latest consensus state: current_term: 1 leader_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "886d4015aabd4e08bf94f21ab8b58ecc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36843 } } }
I20260807 19:48:46.724442 21743 sys_catalog.cc:458] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:46.726250 21749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:46.733582 21749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:46.744426 21749 catalog_manager.cc:1347] Generated new cluster ID: 211fc572959b446b9fb6910fb976e707
I20260807 19:48:46.744608 21749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:46.765477 21749 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:46.767463 21749 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:46.778455 21749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 886d4015aabd4e08bf94f21ab8b58ecc: Generated new TSK 0
I20260807 19:48:46.779976 21749 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 19:48:46.826655 21778 webserver.cc:533] Webserver: sslize failed: error:14094415:SSL routines:ssl3_read_bytes:sslv3 alert certificate expired
E20260807 19:48:46.827030 21778 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 19:48:46.829879 21738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:46.802157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46284 (local address 127.12.155.190:36843)
0807 19:48:46.802417 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:46.802424 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:46.802972 (+ 548us) server_negotiation.cc:407] Connection header received
0807 19:48:46.803430 (+ 458us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:46.803437 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:46.803558 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:46.803752 (+ 194us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:48:46.804571 (+ 819us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:46.805881 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:46.807816 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:46.808610 (+ 794us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:46.808766 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:46.809624 (+ 858us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:48:46.828797 (+ 19173us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 19:48:46.829409 (+ 612us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:46284: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"server-negotiator.queue_time_us":100}
W20260807 19:48:46.830135 21738 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:46284: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
W20260807 19:48:46.832244 21777 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:46.801932 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36843 (local address 127.0.0.1:46284)
0807 19:48:46.802822 (+ 890us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:46.802843 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:46.803057 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:46.803893 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:46.803898 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:46.803911 (+ 13us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:48:46.804331 (+ 420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:46.804343 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:46.806170 (+ 1827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:46.806176 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:46.807625 (+ 1449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:46.807641 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:46.808898 (+ 1257us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:46.808905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:46.809075 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:46.809179 (+ 104us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:48:46.829380 (+ 20201us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
0807 19:48:46.829903 (+ 523us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.155.190:36843: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Metrics: {"client-negotiator.queue_time_us":640,"thread_start_us":469,"threads_started":1}
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:597: Failure
Failed
Bad status: Runtime error: Could not connect to the cluster: Client connection negotiation failed: client connection to 127.12.155.190:36843: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:39535/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: certificate has expired
Google Test trace:
/data0/somelongdirectorytoavoidrpathissues/src/kudu/src/kudu/integration-tests/security-itest.cc:593: Valid JWT
I20260807 19:48:46.834823 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 21622
I20260807 19:48:46.836494 21725 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:46.948237 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 21622
2026-08-07T19:48:46Z chronyd exiting
I20260807 19:48:47.016170 12910 test_util.cc:175] -----------------------------------------------
I20260807 19:48:47.016422 12910 test_util.cc:176] Had fatal failures, leaving test files at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniCluster.1786132073392555-12910-0
[ FAILED ] SecurityITest.TestJwtMiniCluster (933 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithInvalidCert
I20260807 19:48:47.021067 12910 mini_oidc.cc:152] Starting JWKS server
I20260807 19:48:47.023432 12910 webserver.cc:460] Webserver started at https://127.0.0.1:37091/ using document root <none> and password file <none>
I20260807 19:48:47.023751 12910 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 19:48:47.024588 12910 webserver.cc:460] Webserver started at http://127.0.0.1:38361/ using document root <none> and password file <none>
2026-08-07T19:48:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:47Z Disabled control of system clock
I20260807 19:48:47.073938 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38009
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:36607
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:38009
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37091/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/testchainca.cert with env {}
W20260807 19:48:47.490665 21791 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:47.491142 21791 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:47.491334 21791 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:47.499460 21791 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:47.499693 21791 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:47.499802 21791 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:47.499922 21791 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:47.500015 21791 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:48:47.500118 21791 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:48:47.500200 21791 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:37091/jwks.json
I20260807 19:48:47.511833 21791 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:36607
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:38009
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38009
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:37091/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:47.513698 21791 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:47.515552 21791 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:47.537019 21804 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:47.537043 21800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:47.537086 21802 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:47.538239 21791 server_base.cc:1034] running on GCE node
I20260807 19:48:47.539719 21791 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:47.542325 21791 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:47.543591 21791 hybrid_clock.cc:648] HybridClock initialized: now 1786132127543516 us; error 75 us; skew 500 ppm
I20260807 19:48:47.544203 21791 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:47.547703 21791 webserver.cc:460] Webserver started at http://127.12.155.190:44283/ using document root <none> and password file <none>
I20260807 19:48:47.548673 21791 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:47.548842 21791 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:47.549297 21791 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:47.553280 21791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "c1ffff18b3fb46daa099e9704b77e41a"
format_stamp: "Formatted at 2026-08-07 19:48:47 on dist-test-slave-2p8l"
server_key: "08d964b9d4978b281080573b61ae415d"
server_key_iv: "740efcbb9e1a2919bc6dfc01307ca364"
server_key_version: "encryptionkey@0"
I20260807 19:48:47.554416 21791 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "c1ffff18b3fb46daa099e9704b77e41a"
format_stamp: "Formatted at 2026-08-07 19:48:47 on dist-test-slave-2p8l"
server_key: "08d964b9d4978b281080573b61ae415d"
server_key_iv: "740efcbb9e1a2919bc6dfc01307ca364"
server_key_version: "encryptionkey@0"
I20260807 19:48:47.561241 21791 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.001s sys 0.005s
I20260807 19:48:47.565865 21812 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:47.567708 21791 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:48:47.568011 21791 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "c1ffff18b3fb46daa099e9704b77e41a"
format_stamp: "Formatted at 2026-08-07 19:48:47 on dist-test-slave-2p8l"
server_key: "08d964b9d4978b281080573b61ae415d"
server_key_iv: "740efcbb9e1a2919bc6dfc01307ca364"
server_key_version: "encryptionkey@0"
I20260807 19:48:47.568295 21791 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:47.586225 21791 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:47.587436 21791 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:47.587853 21791 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:47.610335 21791 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:38009
I20260807 19:48:47.610352 21892 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:38009 every 8 connection(s)
I20260807 19:48:47.612181 21791 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:47.615324 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 21791
I20260807 19:48:47.615576 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithInvalidCert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:47.616593 12910 external_mini_cluster.cc:1428] Setting key 22f34e93febda1023aaa7d114b846b77
I20260807 19:48:47.618314 21893 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:47.633524 21893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a: Bootstrap starting.
I20260807 19:48:47.634109 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:47.619213 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60922 (local address 127.12.155.190:38009)
0807 19:48:47.620607 (+ 1394us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:47.620621 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:47.620679 (+ 58us) server_negotiation.cc:407] Connection header received
0807 19:48:47.622757 (+ 2078us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:47.622788 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:47.623434 (+ 646us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:47.623978 (+ 544us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:47.624795 (+ 817us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:47.626584 (+ 1789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:47.628145 (+ 1561us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:47.628966 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:47.629226 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:47.630946 (+ 1720us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:47.630955 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:47.630977 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:47.631718 (+ 741us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:47.631825 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:47.631853 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:47.632008 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:47.632283 (+ 275us) server_negotiation.cc:299] Negotiation successful
0807 19:48:47.632730 (+ 447us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":836,"thread_start_us":549,"threads_started":1}
I20260807 19:48:47.638258 21893 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:47.639433 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:48:47.639895 21893 log.cc:824] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:47.644172 21893 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a: No bootstrap required, opened a new log
I20260807 19:48:47.653605 21893 raft_consensus.cc:348] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ffff18b3fb46daa099e9704b77e41a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38009 } }
I20260807 19:48:47.654237 21893 raft_consensus.cc:374] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:47.654376 21893 raft_consensus.cc:729] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: c1ffff18b3fb46daa099e9704b77e41a, State: Initialized, Role: FOLLOWER
I20260807 19:48:47.655230 21893 consensus_queue.cc:260] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ffff18b3fb46daa099e9704b77e41a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38009 } }
I20260807 19:48:47.655576 21893 raft_consensus.cc:388] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:47.655773 21893 raft_consensus.cc:482] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:47.656002 21893 raft_consensus.cc:3037] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:47.658684 21893 raft_consensus.cc:504] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ffff18b3fb46daa099e9704b77e41a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38009 } }
I20260807 19:48:47.659343 21893 leader_election.cc:302] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: c1ffff18b3fb46daa099e9704b77e41a; no voters:
I20260807 19:48:47.660099 21893 leader_election.cc:288] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:47.660318 21902 raft_consensus.cc:2781] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:47.661652 21902 raft_consensus.cc:686] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [term 1 LEADER]: Becoming Leader. State: Replica: c1ffff18b3fb46daa099e9704b77e41a, State: Running, Role: LEADER
I20260807 19:48:47.662412 21902 consensus_queue.cc:237] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ffff18b3fb46daa099e9704b77e41a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38009 } }
I20260807 19:48:47.662999 21893 sys_catalog.cc:564] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:47.665678 21907 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [sys.catalog]: SysCatalogTable state changed. Reason: New leader c1ffff18b3fb46daa099e9704b77e41a. Latest consensus state: current_term: 1 leader_uuid: "c1ffff18b3fb46daa099e9704b77e41a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ffff18b3fb46daa099e9704b77e41a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38009 } } }
I20260807 19:48:47.666165 21907 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:47.666904 21903 sys_catalog.cc:455] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "c1ffff18b3fb46daa099e9704b77e41a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "c1ffff18b3fb46daa099e9704b77e41a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38009 } } }
I20260807 19:48:47.667892 21903 sys_catalog.cc:458] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:47.669380 21914 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:47.676592 21914 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:47.690114 21914 catalog_manager.cc:1347] Generated new cluster ID: 181a07be10e443a9ac24ff885566ef1a
I20260807 19:48:47.690289 21914 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:47.708388 21914 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:47.710676 21914 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:47.720072 21914 catalog_manager.cc:5868] T 00000000000000000000000000000000 P c1ffff18b3fb46daa099e9704b77e41a: Generated new TSK 0
I20260807 19:48:47.721398 21914 catalog_manager.cc:1514] Initializing in-progress tserver states...
E20260807 19:48:47.759544 21945 webserver.cc:533] Webserver: sslize failed: error:14094418:SSL routines:ssl3_read_bytes:tlsv1 alert unknown ca
E20260807 19:48:47.759727 21945 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 19:48:47.761194 21897 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:47.739086 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60934 (local address 127.12.155.190:38009)
0807 19:48:47.739408 (+ 322us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:47.739417 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:47.739808 (+ 391us) server_negotiation.cc:407] Connection header received
0807 19:48:47.740053 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:47.740058 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:47.740159 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:47.740332 (+ 173us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:48:47.740990 (+ 658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:47.741876 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:47.744156 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:47.744695 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:47.744877 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:47.745603 (+ 726us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:48:47.760407 (+ 14804us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37091/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 19:48:47.760884 (+ 477us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60934: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37091/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"server-negotiator.queue_time_us":128}
W20260807 19:48:47.761384 21897 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60934: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37091/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
W20260807 19:48:47.761668 21943 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:47.738798 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38009 (local address 127.0.0.1:60934)
0807 19:48:47.739603 (+ 805us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:47.739628 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:47.739842 (+ 214us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:47.740384 (+ 542us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:47.740390 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:47.740409 (+ 19us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:48:47.740780 (+ 371us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:47.740794 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:47.742086 (+ 1292us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:47.742094 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:47.743961 (+ 1867us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:47.743980 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:47.744953 (+ 973us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:47.744960 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:47.745175 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:47.745230 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:48:47.760776 (+ 15546us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37091/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
0807 19:48:47.761185 (+ 409us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.155.190:38009: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:37091/jwks.json': curl error: SSL peer certificate or SSH remote key was not OK: SSL certificate problem: unable to get local issuer certificate
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":424,"threads_started":1}
I20260807 19:48:47.763309 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 21791
I20260807 19:48:47.764925 21887 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:47.872154 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 21791
2026-08-07T19:48:47Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithInvalidCert (925 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithUntrustedCert
I20260807 19:48:47.946203 12910 mini_oidc.cc:152] Starting JWKS server
I20260807 19:48:47.948695 12910 webserver.cc:460] Webserver started at https://127.0.0.1:46399/ using document root <none> and password file <none>
I20260807 19:48:47.948966 12910 mini_oidc.cc:189] Starting OIDC Discovery server
I20260807 19:48:47.949661 12910 webserver.cc:460] Webserver started at http://127.0.0.1:44397/ using document root <none> and password file <none>
2026-08-07T19:48:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:47Z Disabled control of system clock
I20260807 19:48:47.995604 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45069
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:41863
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:45069
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46399/jwks.json
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 19:48:48.414961 21954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:48.415367 21954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:48.415565 21954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:48.423919 21954 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:48.424074 21954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:48.424142 21954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:48.424253 21954 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:48.424319 21954 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:48:48.424407 21954 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:48:48.424504 21954 flags.cc:425] Enabled experimental flag: --jwks_url=https://localhost:46399/jwks.json
I20260807 19:48:48.435187 21954 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41863
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:45069
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45069
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=https://localhost:46399/jwks.json
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:48.437193 21954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:48.439733 21954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:48.454979 21961 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:48.454977 21962 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:48.455031 21965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:48.456166 21954 server_base.cc:1034] running on GCE node
I20260807 19:48:48.457419 21954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:48.459798 21954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:48.461076 21954 hybrid_clock.cc:648] HybridClock initialized: now 1786132128461013 us; error 40 us; skew 500 ppm
I20260807 19:48:48.461660 21954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:48.464847 21954 webserver.cc:460] Webserver started at http://127.12.155.190:41613/ using document root <none> and password file <none>
I20260807 19:48:48.465838 21954 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:48.466012 21954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:48.466553 21954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:48.470844 21954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "09e00b001b444f0c8adb7319ab3e5057"
format_stamp: "Formatted at 2026-08-07 19:48:48 on dist-test-slave-2p8l"
server_key: "7d1261a225b3043b2275be50cc4497b2"
server_key_iv: "81d15792a4cf9cf87705456ed989528e"
server_key_version: "encryptionkey@0"
I20260807 19:48:48.472004 21954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "09e00b001b444f0c8adb7319ab3e5057"
format_stamp: "Formatted at 2026-08-07 19:48:48 on dist-test-slave-2p8l"
server_key: "7d1261a225b3043b2275be50cc4497b2"
server_key_iv: "81d15792a4cf9cf87705456ed989528e"
server_key_version: "encryptionkey@0"
I20260807 19:48:48.479199 21954 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 19:48:48.483637 21982 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:48.485421 21954 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:48:48.485670 21954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "09e00b001b444f0c8adb7319ab3e5057"
format_stamp: "Formatted at 2026-08-07 19:48:48 on dist-test-slave-2p8l"
server_key: "7d1261a225b3043b2275be50cc4497b2"
server_key_iv: "81d15792a4cf9cf87705456ed989528e"
server_key_version: "encryptionkey@0"
I20260807 19:48:48.485958 21954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:48.531622 21954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:48.532837 21954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:48.533247 21954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:48.555575 21954 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:45069
I20260807 19:48:48.555598 22064 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:45069 every 8 connection(s)
I20260807 19:48:48.557384 21954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:48.560530 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 21954
I20260807 19:48:48.560815 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithUntrustedCert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:48.561769 12910 external_mini_cluster.cc:1428] Setting key 57384b880f992e11085f947ae66ebd98
I20260807 19:48:48.562923 22066 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:48.577941 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:48.564188 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51142 (local address 127.12.155.190:45069)
0807 19:48:48.565400 (+ 1212us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:48.565414 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:48.565465 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:48:48.567257 (+ 1792us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:48.567285 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:48.567837 (+ 552us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:48.568231 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:48.568973 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:48.570505 (+ 1532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:48.572561 (+ 2056us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:48.573336 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:48.573514 (+ 178us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:48.574989 (+ 1475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:48.574997 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:48.575016 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:48.575736 (+ 720us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:48.575885 (+ 149us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:48.575914 (+ 29us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:48.576019 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:48.576288 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 19:48:48.576722 (+ 434us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":720,"thread_start_us":463,"threads_started":1}
I20260807 19:48:48.579018 22066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057: Bootstrap starting.
I20260807 19:48:48.583367 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:48:48.583842 22066 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:48.585494 22066 log.cc:824] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:48.590020 22066 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057: No bootstrap required, opened a new log
I20260807 19:48:48.599309 22066 raft_consensus.cc:348] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09e00b001b444f0c8adb7319ab3e5057" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45069 } }
I20260807 19:48:48.599859 22066 raft_consensus.cc:374] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:48.599959 22066 raft_consensus.cc:729] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 09e00b001b444f0c8adb7319ab3e5057, State: Initialized, Role: FOLLOWER
I20260807 19:48:48.600744 22066 consensus_queue.cc:260] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09e00b001b444f0c8adb7319ab3e5057" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45069 } }
I20260807 19:48:48.601094 22066 raft_consensus.cc:388] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:48.601302 22066 raft_consensus.cc:482] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:48.601522 22066 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:48.604295 22066 raft_consensus.cc:504] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09e00b001b444f0c8adb7319ab3e5057" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45069 } }
I20260807 19:48:48.605048 22066 leader_election.cc:302] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 09e00b001b444f0c8adb7319ab3e5057; no voters:
I20260807 19:48:48.605837 22066 leader_election.cc:288] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:48.606033 22074 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:48.606946 22074 raft_consensus.cc:686] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [term 1 LEADER]: Becoming Leader. State: Replica: 09e00b001b444f0c8adb7319ab3e5057, State: Running, Role: LEADER
I20260807 19:48:48.607800 22074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09e00b001b444f0c8adb7319ab3e5057" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45069 } }
I20260807 19:48:48.608851 22066 sys_catalog.cc:564] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:48.611748 22078 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 09e00b001b444f0c8adb7319ab3e5057. Latest consensus state: current_term: 1 leader_uuid: "09e00b001b444f0c8adb7319ab3e5057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09e00b001b444f0c8adb7319ab3e5057" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45069 } } }
I20260807 19:48:48.612346 22078 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:48.611888 22075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "09e00b001b444f0c8adb7319ab3e5057" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "09e00b001b444f0c8adb7319ab3e5057" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45069 } } }
I20260807 19:48:48.612673 22075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:48.615036 22087 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:48.622026 22087 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:48.633278 22087 catalog_manager.cc:1347] Generated new cluster ID: d3fcb908d23245868155a57e956a7d64
I20260807 19:48:48.633457 22087 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:48.664193 22087 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:48.666790 22087 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:48.676939 22087 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 09e00b001b444f0c8adb7319ab3e5057: Generated new TSK 0
I20260807 19:48:48.678385 22087 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:48:48.706174 22070 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:48.695534 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51144 (local address 127.12.155.190:45069)
0807 19:48:48.695797 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:48.695805 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:48.696215 (+ 410us) server_negotiation.cc:407] Connection header received
0807 19:48:48.696505 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:48.696512 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:48.696624 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:48.696830 (+ 206us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:48:48.697377 (+ 547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:48.698595 (+ 1218us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:48.700147 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:48.701054 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:48.701241 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:48.701843 (+ 602us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:48:48.705193 (+ 3350us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46399/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 19:48:48.705684 (+ 491us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:51144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46399/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"server-negotiator.queue_time_us":86}
W20260807 19:48:48.706521 22070 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:51144: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46399/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
W20260807 19:48:48.707510 22108 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:48.695360 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45069 (local address 127.0.0.1:51144)
0807 19:48:48.696091 (+ 731us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:48.696109 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:48.696266 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:48.696855 (+ 589us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:48.696858 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:48.696870 (+ 12us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:48:48.697215 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:48.697224 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:48.698758 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:48.698763 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:48.699959 (+ 1196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:48.699974 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:48.701276 (+ 1302us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:48.701280 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:48.701421 (+ 141us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:48.701460 (+ 39us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:48:48.705485 (+ 4025us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46399/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
0807 19:48:48.707019 (+ 1534us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.155.190:45069: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'https://localhost:46399/jwks.json': curl error: Problem with the SSL CA cert (path? access rights?): error setting certificate verify locations:
CAfile: /etc/pki/tls/certs/ca-bundle.crt
CApath: none
Metrics: {"client-negotiator.queue_time_us":577,"mutex_wait_us":1182,"thread_start_us":408,"threads_started":1}
I20260807 19:48:48.709160 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 21954
I20260807 19:48:48.710741 22059 generic_service.cc:196] Checking for leaks (request via RPC)
E20260807 19:48:48.717555 22110 webserver.cc:533] Webserver: sslize failed:
E20260807 19:48:48.717674 22110 webserver.cc:533] Webserver: error shutting down SSL connection: error:140E0197:SSL routines:SSL_shutdown:shutdown while in init
I20260807 19:48:48.815266 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 21954
2026-08-07T19:48:48Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithUntrustedCert (941 ms)
[ RUN ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS
2026-08-07T19:48:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:48Z Disabled control of system clock
I20260807 19:48:48.935828 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:33333
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:33705
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:33333
--enable_jwt_token_auth=true
--jwks_url=default.url
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--trusted_certificate_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/testchainca.cert with env {}
W20260807 19:48:49.359594 22121 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:49.359966 22121 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:49.360136 22121 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:49.368196 22121 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:49.368330 22121 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:49.368371 22121 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:49.368450 22121 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:49.368522 22121 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
W20260807 19:48:49.368638 22121 flags.cc:425] Enabled experimental flag: --enable_jwt_token_auth=true
W20260807 19:48:49.368700 22121 flags.cc:425] Enabled experimental flag: --jwks_url=default.url
I20260807 19:48:49.380088 22121 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33705
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:33333
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:33333
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--enable_jwt_token_auth=true
--jwks_url=default.url
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--trusted_certificate_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/testchainca.cert
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:49.381925 22121 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:49.383634 22121 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:49.397950 22130 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:49.397866 22131 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:49.397917 22133 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:49.399158 22121 server_base.cc:1034] running on GCE node
I20260807 19:48:49.400087 22121 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:49.401767 22121 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:49.402979 22121 hybrid_clock.cc:648] HybridClock initialized: now 1786132129402910 us; error 70 us; skew 500 ppm
I20260807 19:48:49.403412 22121 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:48:49.406291 22121 webserver.cc:460] Webserver started at http://127.12.155.190:43841/ using document root <none> and password file <none>
I20260807 19:48:49.407176 22121 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:49.407327 22121 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:49.407708 22121 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:49.411403 22121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "288582793b8d45e2ad71ea7ac55fe1be"
format_stamp: "Formatted at 2026-08-07 19:48:49 on dist-test-slave-2p8l"
server_key: "86565e71cb4661cf3573196dad06445d"
server_key_iv: "11bc12953525b93d5ca9e972b4c30e26"
server_key_version: "encryptionkey@0"
I20260807 19:48:49.412369 22121 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "288582793b8d45e2ad71ea7ac55fe1be"
format_stamp: "Formatted at 2026-08-07 19:48:49 on dist-test-slave-2p8l"
server_key: "86565e71cb4661cf3573196dad06445d"
server_key_iv: "11bc12953525b93d5ca9e972b4c30e26"
server_key_version: "encryptionkey@0"
I20260807 19:48:49.418785 22121 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:48:49.423015 22141 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:49.425097 22121 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:48:49.425381 22121 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "288582793b8d45e2ad71ea7ac55fe1be"
format_stamp: "Formatted at 2026-08-07 19:48:49 on dist-test-slave-2p8l"
server_key: "86565e71cb4661cf3573196dad06445d"
server_key_iv: "11bc12953525b93d5ca9e972b4c30e26"
server_key_version: "encryptionkey@0"
I20260807 19:48:49.425693 22121 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:49.451594 22121 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:49.452759 22121 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:49.453140 22121 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:49.475737 22121 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:33333
I20260807 19:48:49.475760 22234 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:33333 every 8 connection(s)
I20260807 19:48:49.477509 22121 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:49.482628 22235 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:49.486835 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 22121
I20260807 19:48:49.487089 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:49.488073 12910 external_mini_cluster.cc:1428] Setting key ac7c745be16c4be51f593347872c6e77
I20260807 19:48:49.497961 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be: Bootstrap starting.
I20260807 19:48:49.502033 22235 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:49.503854 22235 log.cc:824] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be: Log is configured to *not* fsync() on all Append() calls
I20260807 19:48:49.505030 22241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:49.490793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60338 (local address 127.12.155.190:33333)
0807 19:48:49.492048 (+ 1255us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:49.492062 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:49.492118 (+ 56us) server_negotiation.cc:407] Connection header received
0807 19:48:49.493932 (+ 1814us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:49.493963 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:49.494654 (+ 691us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:49.495194 (+ 540us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:49.495892 (+ 698us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:49.497303 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:49.498911 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:49.499666 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:49.499922 (+ 256us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:49.501290 (+ 1368us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:49.501298 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:49.501316 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:48:49.502573 (+ 1257us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:49.502706 (+ 133us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:48:49.502739 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:49.502919 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:49.503207 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 19:48:49.503640 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":695,"thread_start_us":395,"threads_started":1}
I20260807 19:48:49.507691 22235 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be: No bootstrap required, opened a new log
I20260807 19:48:49.510001 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:48:49.516793 22235 raft_consensus.cc:348] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288582793b8d45e2ad71ea7ac55fe1be" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33333 } }
I20260807 19:48:49.517349 22235 raft_consensus.cc:374] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:49.517482 22235 raft_consensus.cc:729] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 288582793b8d45e2ad71ea7ac55fe1be, State: Initialized, Role: FOLLOWER
I20260807 19:48:49.518275 22235 consensus_queue.cc:260] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288582793b8d45e2ad71ea7ac55fe1be" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33333 } }
I20260807 19:48:49.518553 22235 raft_consensus.cc:388] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:49.518723 22235 raft_consensus.cc:482] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:49.518911 22235 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:49.521420 22235 raft_consensus.cc:504] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288582793b8d45e2ad71ea7ac55fe1be" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33333 } }
I20260807 19:48:49.522034 22235 leader_election.cc:302] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 288582793b8d45e2ad71ea7ac55fe1be; no voters:
I20260807 19:48:49.522945 22235 leader_election.cc:288] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:49.523145 22243 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:49.524048 22243 raft_consensus.cc:686] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [term 1 LEADER]: Becoming Leader. State: Replica: 288582793b8d45e2ad71ea7ac55fe1be, State: Running, Role: LEADER
I20260807 19:48:49.524705 22243 consensus_queue.cc:237] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288582793b8d45e2ad71ea7ac55fe1be" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33333 } }
I20260807 19:48:49.525609 22235 sys_catalog.cc:564] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:49.528199 22244 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "288582793b8d45e2ad71ea7ac55fe1be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288582793b8d45e2ad71ea7ac55fe1be" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33333 } } }
I20260807 19:48:49.529052 22244 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:49.529064 22245 sys_catalog.cc:455] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [sys.catalog]: SysCatalogTable state changed. Reason: New leader 288582793b8d45e2ad71ea7ac55fe1be. Latest consensus state: current_term: 1 leader_uuid: "288582793b8d45e2ad71ea7ac55fe1be" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "288582793b8d45e2ad71ea7ac55fe1be" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33333 } } }
I20260807 19:48:49.533993 22245 sys_catalog.cc:458] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:49.535027 22256 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:49.542208 22256 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:49.554193 22256 catalog_manager.cc:1347] Generated new cluster ID: 015694787e8547db86a3b3a207bb3591
I20260807 19:48:49.554364 22256 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:49.591388 22256 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:49.593946 22256 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:49.607492 22256 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 288582793b8d45e2ad71ea7ac55fe1be: Generated new TSK 0
I20260807 19:48:49.608711 22256 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:48:50.477398 22241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:49.634515 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60346 (local address 127.12.155.190:33333)
0807 19:48:49.634833 (+ 318us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:49.634841 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:49.635267 (+ 426us) server_negotiation.cc:407] Connection header received
0807 19:48:49.635584 (+ 317us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:49.635589 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:49.635699 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:49.635918 (+ 219us) server_negotiation.cc:226] Negotiated authn=JWT
0807 19:48:49.636572 (+ 654us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:49.637379 (+ 807us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:49.639569 (+ 2190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:49.640063 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:49.640168 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:49.640812 (+ 644us) server_negotiation.cc:365] Received JWT_EXCHANGE NegotiatePB request
0807 19:48:50.476480 (+835668us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 19:48:50.477028 (+ 548us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:60346: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"server-negotiator.queue_time_us":87}
W20260807 19:48:50.477586 22241 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:60346: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
W20260807 19:48:50.477823 22283 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:49.634384 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:33333 (local address 127.0.0.1:60346)
0807 19:48:49.635136 (+ 752us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:49.635160 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:49.635366 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:49.635973 (+ 607us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:49.635980 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:49.635995 (+ 15us) client_negotiation.cc:189] Negotiated authn=JWT
0807 19:48:49.636358 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:49.636375 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:49.637541 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:49.637547 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:49.639418 (+ 1871us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:49.639439 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:49.640261 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:49.640269 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:49.640474 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:49.640529 (+ 55us) client_negotiation.cc:252] Sending JWT_EXCHANGE NegotiatePB request
0807 19:48:50.476934 (+836405us) client_negotiation.cc:283] Received error response from server: Runtime error: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
0807 19:48:50.477321 (+ 387us) negotiation.cc:327] Negotiation complete: Runtime error: Client connection negotiation failed: client connection to 127.12.155.190:33333: FATAL_INVALID_JWT: Not authorized: Failed to load JWKS: Error downloading JWKS from 'default.url': curl error: Couldn't resolve host name: Could not resolve host: default.url
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":357,"threads_started":1}
I20260807 19:48:50.479450 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 22121
I20260807 19:48:50.481271 22227 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:50.607527 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 22121
2026-08-07T19:48:50Z chronyd exiting
[ OK ] SecurityITest.TestJwtMiniClusterWithNonWorkingJWKS (1772 ms)
[ RUN ] SecurityITest.TestWorldReadableKeytab
[ OK ] SecurityITest.TestWorldReadableKeytab (546 ms)
[ RUN ] SecurityITest.TestWorldReadablePrivateKey
[ OK ] SecurityITest.TestWorldReadablePrivateKey (505 ms)
[ RUN ] SecurityITest.TestCorruptKerberosCC
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:51 dist-test-slave-2p8l krb5kdc[22306](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:51 dist-test-slave-2p8l krb5kdc[22306](info): set up 2 sockets
Aug 07 19:48:51 dist-test-slave-2p8l krb5kdc[22306](info): commencing operation
krb5kdc: starting...
W20260807 19:48:53.137566 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.424s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:53 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:48:53.451002 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45385
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:45385
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:53.874248 22322 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:53.874651 22322 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:53.874953 22322 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:53.883188 22322 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:53.883352 22322 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:53.883473 22322 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:53.883590 22322 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:53.883678 22322 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:53.895143 22322 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:45385
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45385
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:53.897065 22322 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:53.898895 22322 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:53.914750 22333 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:53.914939 22331 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:53.914901 22335 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:53.915951 22322 server_base.cc:1034] running on GCE node
I20260807 19:48:53.917095 22322 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:53.919275 22322 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:53.920589 22322 hybrid_clock.cc:648] HybridClock initialized: now 1786132133920507 us; error 77 us; skew 500 ppm
I20260807 19:48:53.921195 22322 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:53 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132133, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:53.925959 22322 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:48:53.928097 22322 webserver.cc:460] Webserver started at http://127.12.155.190:33673/ using document root <none> and password file <none>
I20260807 19:48:53.929010 22322 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:53.929132 22322 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:53.929482 22322 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:53.933430 22322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "5947039aa8174d6aac98c5c52080095b"
format_stamp: "Formatted at 2026-08-07 19:48:53 on dist-test-slave-2p8l"
server_key: "97ae7d2285f2bac0ac11c0b70ebec3ea"
server_key_iv: "17a612b15075f320653e1f5eb4530ca6"
server_key_version: "encryptionkey@0"
I20260807 19:48:53.934517 22322 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "5947039aa8174d6aac98c5c52080095b"
format_stamp: "Formatted at 2026-08-07 19:48:53 on dist-test-slave-2p8l"
server_key: "97ae7d2285f2bac0ac11c0b70ebec3ea"
server_key_iv: "17a612b15075f320653e1f5eb4530ca6"
server_key_version: "encryptionkey@0"
I20260807 19:48:53.941541 22322 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:48:53.946445 22346 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:53.948236 22322 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:48:53.948494 22322 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "5947039aa8174d6aac98c5c52080095b"
format_stamp: "Formatted at 2026-08-07 19:48:53 on dist-test-slave-2p8l"
server_key: "97ae7d2285f2bac0ac11c0b70ebec3ea"
server_key_iv: "17a612b15075f320653e1f5eb4530ca6"
server_key_version: "encryptionkey@0"
I20260807 19:48:53.948822 22322 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:54.000216 22322 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:54.005877 22322 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:54.006305 22322 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:54.028143 22322 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:45385
I20260807 19:48:54.028163 22432 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:45385 every 8 connection(s)
I20260807 19:48:54.029932 22322 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:54.034657 22434 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:54.037498 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 22322
I20260807 19:48:54.037762 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:54.038784 12910 external_mini_cluster.cc:1428] Setting key bd845708afd890ea863bea9d2494e9c0
I20260807 19:48:54.049593 22434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b: Bootstrap starting.
I20260807 19:48:54.054548 22434 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:54.056231 22434 log.cc:824] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:48:54 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132133, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:54.060163 22434 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b: No bootstrap required, opened a new log
I20260807 19:48:54.067291 22445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:54.041542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58412 (local address 127.12.155.190:45385)
0807 19:48:54.042526 (+ 984us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:54.042540 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:54.042592 (+ 52us) server_negotiation.cc:407] Connection header received
0807 19:48:54.044540 (+ 1948us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:54.044570 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:54.045059 (+ 489us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:54.045476 (+ 417us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:54.047658 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:54.049242 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:54.051173 (+ 1931us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:54.052099 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:54.052310 (+ 211us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:54.058291 (+ 5981us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:54.058301 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:54.058323 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:54.058369 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:54.061942 (+ 3573us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:54.062889 (+ 947us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:54.062897 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:54.062905 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:54.063117 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:54.063582 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:54.063587 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:54.063589 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:54.064390 (+ 801us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:54.064762 (+ 372us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:54.065327 (+ 565us) server_negotiation.cc:299] Negotiation successful
0807 19:48:54.065875 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":731,"thread_start_us":480,"threads_started":1}
I20260807 19:48:54.069994 22434 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5947039aa8174d6aac98c5c52080095b" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45385 } }
I20260807 19:48:54.070542 22434 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:54.070683 22434 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5947039aa8174d6aac98c5c52080095b, State: Initialized, Role: FOLLOWER
I20260807 19:48:54.071503 22434 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5947039aa8174d6aac98c5c52080095b" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45385 } }
I20260807 19:48:54.071818 22434 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:54.071983 22434 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:54.072170 22434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:54.074793 22434 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5947039aa8174d6aac98c5c52080095b" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45385 } }
I20260807 19:48:54.075392 22434 leader_election.cc:302] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5947039aa8174d6aac98c5c52080095b; no voters:
I20260807 19:48:54.076191 22434 leader_election.cc:288] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:54.076344 22447 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:54.077775 22447 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [term 1 LEADER]: Becoming Leader. State: Replica: 5947039aa8174d6aac98c5c52080095b, State: Running, Role: LEADER
I20260807 19:48:54.078495 22447 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5947039aa8174d6aac98c5c52080095b" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45385 } }
I20260807 19:48:54.079334 22434 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:54.082180 22450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5947039aa8174d6aac98c5c52080095b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5947039aa8174d6aac98c5c52080095b" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45385 } } }
I20260807 19:48:54.082670 22450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:54.086336 22453 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5947039aa8174d6aac98c5c52080095b. Latest consensus state: current_term: 1 leader_uuid: "5947039aa8174d6aac98c5c52080095b" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5947039aa8174d6aac98c5c52080095b" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45385 } } }
I20260807 19:48:54.086768 22453 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:54.088613 22461 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:54.095477 22461 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:54.106731 22461 catalog_manager.cc:1347] Generated new cluster ID: 710425a03ea544d2adb5f96900dc5141
I20260807 19:48:54.106889 22461 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:54.134099 22461 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:54.135967 22461 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:54.147028 22461 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5947039aa8174d6aac98c5c52080095b: Generated new TSK 0
I20260807 19:48:54.148268 22461 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:48:54.231082 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45385
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:54.661445 22481 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:54.661849 22481 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:54.661967 22481 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:54.670257 22481 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:54.670416 22481 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:54.670552 22481 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:54.681917 22481 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:54.683759 22481 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:54.685943 22481 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:54.702708 22496 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:54.702818 22489 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:54.702837 22493 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:54.703670 22481 server_base.cc:1034] running on GCE node
I20260807 19:48:54.704427 22481 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:54.705612 22481 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:54.706852 22481 hybrid_clock.cc:648] HybridClock initialized: now 1786132134706814 us; error 73 us; skew 500 ppm
I20260807 19:48:54.707244 22481 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:54 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132134, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:54.715098 22481 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:48:54.717304 22481 webserver.cc:460] Webserver started at http://127.12.155.129:45269/ using document root <none> and password file <none>
I20260807 19:48:54.718433 22481 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:54.718616 22481 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:54.719061 22481 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:54.723047 22481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "60375cc9d05644fab3586ad0f070bee8"
format_stamp: "Formatted at 2026-08-07 19:48:54 on dist-test-slave-2p8l"
server_key: "3f29d22c7f9f77e62d12cb2609025ff3"
server_key_iv: "be77791ed802f2fc077f7d3a6d56abda"
server_key_version: "encryptionkey@0"
I20260807 19:48:54.724013 22481 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "60375cc9d05644fab3586ad0f070bee8"
format_stamp: "Formatted at 2026-08-07 19:48:54 on dist-test-slave-2p8l"
server_key: "3f29d22c7f9f77e62d12cb2609025ff3"
server_key_iv: "be77791ed802f2fc077f7d3a6d56abda"
server_key_version: "encryptionkey@0"
I20260807 19:48:54.730829 22481 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.000s
I20260807 19:48:54.735304 22508 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:54.737282 22481 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:48:54.737569 22481 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "60375cc9d05644fab3586ad0f070bee8"
format_stamp: "Formatted at 2026-08-07 19:48:54 on dist-test-slave-2p8l"
server_key: "3f29d22c7f9f77e62d12cb2609025ff3"
server_key_iv: "be77791ed802f2fc077f7d3a6d56abda"
server_key_version: "encryptionkey@0"
I20260807 19:48:54.737874 22481 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:54.766191 22481 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:54.775184 22481 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:54.775661 22481 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:54.776979 22481 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:54.778981 22481 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:54.779151 22481 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 19:48:54.779343 22481 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:54.779464 22481 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:54.826957 22481 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34861
I20260807 19:48:54.826972 22688 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34861 every 8 connection(s)
I20260807 19:48:54.828697 22481 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:54.833159 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 22481
I20260807 19:48:54.833421 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:54.834309 12910 external_mini_cluster.cc:1428] Setting key 1503f80655b55dcc0738e10c232875d9
Aug 07 19:48:54 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132134, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:54.856683 22692 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:54.832161 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51081 (local address 127.12.155.190:45385)
0807 19:48:54.832924 (+ 763us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:54.832933 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:54.834252 (+ 1319us) server_negotiation.cc:407] Connection header received
0807 19:48:54.836687 (+ 2435us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:54.836693 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:54.836794 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:54.836936 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:54.839840 (+ 2904us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:54.840718 (+ 878us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:54.843484 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:54.844008 (+ 524us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:54.844150 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:54.849461 (+ 5311us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:54.849468 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:54.849472 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:54.849520 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:54.852867 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:54.853807 (+ 940us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:54.853813 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:54.853816 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:54.853975 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:54.854539 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:54.854545 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:54.854547 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:54.854878 (+ 331us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:54.855063 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:54.855947 (+ 884us) server_negotiation.cc:299] Negotiation successful
0807 19:48:54.856233 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":400,"threads_started":1}
I20260807 19:48:54.858136 22693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:54.832867 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45385 (local address 127.12.155.129:51081)
0807 19:48:54.833868 (+ 1001us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:54.833938 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:54.836218 (+ 2280us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:54.837308 (+ 1090us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:54.837322 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:54.838336 (+ 1014us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:54.839389 (+ 1053us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:54.839434 (+ 45us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:54.840934 (+ 1500us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:54.840943 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:54.843283 (+ 2340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:54.843301 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:54.844294 (+ 993us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:54.844304 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:54.844709 (+ 405us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:54.845732 (+ 1023us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:54.845770 (+ 38us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:54.849132 (+ 3362us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:54.853043 (+ 3911us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:54.853055 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:54.853077 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:54.853632 (+ 555us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:54.854136 (+ 504us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:54.854141 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:54.854145 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:54.854395 (+ 250us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:54.855025 (+ 630us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:54.855034 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:54.855492 (+ 458us) client_negotiation.cc:769] Sending connection context
0807 19:48:54.855817 (+ 325us) client_negotiation.cc:240] Negotiation successful
0807 19:48:54.856529 (+ 712us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":675,"thread_start_us":427,"threads_started":1}
I20260807 19:48:54.860201 22689 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45385
I20260807 19:48:54.860682 22689 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:54.861841 22689 heartbeater.cc:511] Master 127.12.155.190:45385 requested a full tablet report, sending...
I20260807 19:48:54.864863 22372 ts_manager.cc:194] Registered new tserver with Master: 60375cc9d05644fab3586ad0f070bee8 (127.12.155.129:34861)
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
I20260807 19:48:54.866871 22372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:51081
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:48:54.905474 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45385
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:55.331632 22697 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:55.332304 22697 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:55.332485 22697 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:55.340766 22697 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:55.340929 22697 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:55.341061 22697 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:48:55.352995 22697 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:55.355204 22697 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:55.356894 22697 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:55.372988 22705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:55.372962 22709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:55.373217 22706 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:55.374626 22697 server_base.cc:1034] running on GCE node
I20260807 19:48:55.375406 22697 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:55.376603 22697 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:55.377861 22697 hybrid_clock.cc:648] HybridClock initialized: now 1786132135377781 us; error 73 us; skew 500 ppm
I20260807 19:48:55.378319 22697 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:55 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132135, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:55.382369 22697 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:48:55.384101 22697 webserver.cc:460] Webserver started at http://127.12.155.130:37783/ using document root <none> and password file <none>
I20260807 19:48:55.384990 22697 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:55.385152 22697 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:55.385545 22697 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:55.389180 22697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "4465825708744730af024e4d19297694"
format_stamp: "Formatted at 2026-08-07 19:48:55 on dist-test-slave-2p8l"
server_key: "3ab6ab04bd446c239893fedb3d121e83"
server_key_iv: "8af38c0ed0499ee8a59feb320bbf30a6"
server_key_version: "encryptionkey@0"
I20260807 19:48:55.390300 22697 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "4465825708744730af024e4d19297694"
format_stamp: "Formatted at 2026-08-07 19:48:55 on dist-test-slave-2p8l"
server_key: "3ab6ab04bd446c239893fedb3d121e83"
server_key_iv: "8af38c0ed0499ee8a59feb320bbf30a6"
server_key_version: "encryptionkey@0"
I20260807 19:48:55.396498 22697 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:48:55.400682 22725 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:55.402366 22697 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:48:55.402590 22697 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "4465825708744730af024e4d19297694"
format_stamp: "Formatted at 2026-08-07 19:48:55 on dist-test-slave-2p8l"
server_key: "3ab6ab04bd446c239893fedb3d121e83"
server_key_iv: "8af38c0ed0499ee8a59feb320bbf30a6"
server_key_version: "encryptionkey@0"
I20260807 19:48:55.402843 22697 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:55.424225 22697 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:55.429312 22697 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:55.429692 22697 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:55.431032 22697 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:55.432703 22697 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:55.432817 22697 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:55.432989 22697 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:55.433068 22697 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:55.472591 22697 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:43007
I20260807 19:48:55.472630 22922 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:43007 every 8 connection(s)
I20260807 19:48:55.474329 22697 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:48:55.481874 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 22697
I20260807 19:48:55.482147 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:48:55.482895 12910 external_mini_cluster.cc:1428] Setting key 109c812e976e4609b2b9d4f1173834a9
Aug 07 19:48:55 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132135, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:55.502542 22928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:55.477595 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:34507 (local address 127.12.155.190:45385)
0807 19:48:55.478213 (+ 618us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:55.478219 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:55.479502 (+ 1283us) server_negotiation.cc:407] Connection header received
0807 19:48:55.482099 (+ 2597us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:55.482106 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:55.482229 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:55.482359 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:55.484722 (+ 2363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:55.485629 (+ 907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:55.488463 (+ 2834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:55.488928 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:55.489031 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:55.494783 (+ 5752us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:55.494790 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:55.494794 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:55.494838 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:55.498285 (+ 3447us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:55.499415 (+ 1130us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:55.499421 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:55.499424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:55.499579 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:55.500149 (+ 570us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:55.500154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:55.500156 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:55.500549 (+ 393us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:55.500752 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:55.501684 (+ 932us) server_negotiation.cc:299] Negotiation successful
0807 19:48:55.502036 (+ 352us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":278,"threads_started":1}
I20260807 19:48:55.504535 22930 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:55.478320 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45385 (local address 127.12.155.130:34507)
0807 19:48:55.479301 (+ 981us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:55.479353 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:55.481668 (+ 2315us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:55.482690 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:55.482704 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:55.483621 (+ 917us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:55.484535 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:55.484564 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:55.485807 (+ 1243us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:55.485813 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:55.488294 (+ 2481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:55.488316 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:55.489208 (+ 892us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:55.489218 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:55.489643 (+ 425us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:55.490690 (+ 1047us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:55.490739 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:55.494463 (+ 3724us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:55.498471 (+ 4008us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:55.498489 (+ 18us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:55.498519 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:55.499217 (+ 698us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:55.499723 (+ 506us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:55.499728 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:55.499732 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:55.499980 (+ 248us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:55.500704 (+ 724us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:55.500715 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:55.501202 (+ 487us) client_negotiation.cc:769] Sending connection context
0807 19:48:55.501575 (+ 373us) client_negotiation.cc:240] Negotiation successful
0807 19:48:55.502359 (+ 784us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":593,"thread_start_us":338,"threads_started":1}
I20260807 19:48:55.507186 22923 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45385
I20260807 19:48:55.507565 22923 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:55.508947 22923 heartbeater.cc:511] Master 127.12.155.190:45385 requested a full tablet report, sending...
I20260807 19:48:55.511111 22372 ts_manager.cc:194] Registered new tserver with Master: 4465825708744730af024e4d19297694 (127.12.155.130:43007)
I20260807 19:48:55.512502 22372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:34507
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:48:55.558385 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45385
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42581
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:48:55.870867 22689 heartbeater.cc:503] Master 127.12.155.190:45385 was elected leader, sending a full tablet report...
W20260807 19:48:55.978276 22937 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:55.978730 22937 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:55.978945 22937 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:55.987357 22937 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:55.987571 22937 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:55.987774 22937 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:48:55.999415 22937 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42581
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45385
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:56.001341 22937 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:56.003144 22937 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:56.020587 22943 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:56.020566 22944 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:56.020659 22948 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:56.021795 22937 server_base.cc:1034] running on GCE node
I20260807 19:48:56.022727 22937 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:56.024068 22937 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:56.025352 22937 hybrid_clock.cc:648] HybridClock initialized: now 1786132136025293 us; error 50 us; skew 500 ppm
I20260807 19:48:56.025875 22937 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.030421 22937 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:48:56.036895 22937 webserver.cc:460] Webserver started at http://127.12.155.131:34017/ using document root <none> and password file <none>
I20260807 19:48:56.037886 22937 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:56.038127 22937 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:56.038549 22937 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:56.042729 22937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "6ea8fb151568402d9de8e475e4f65bb5"
format_stamp: "Formatted at 2026-08-07 19:48:56 on dist-test-slave-2p8l"
server_key: "5484629bfbd2a53304ae554b2f07084a"
server_key_iv: "b7e5879ac2a39d549b263b725b54f314"
server_key_version: "encryptionkey@0"
I20260807 19:48:56.043748 22937 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "6ea8fb151568402d9de8e475e4f65bb5"
format_stamp: "Formatted at 2026-08-07 19:48:56 on dist-test-slave-2p8l"
server_key: "5484629bfbd2a53304ae554b2f07084a"
server_key_iv: "b7e5879ac2a39d549b263b725b54f314"
server_key_version: "encryptionkey@0"
I20260807 19:48:56.050758 22937 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.002s
I20260807 19:48:56.055642 22960 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:56.057627 22937 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260807 19:48:56.057853 22937 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "6ea8fb151568402d9de8e475e4f65bb5"
format_stamp: "Formatted at 2026-08-07 19:48:56 on dist-test-slave-2p8l"
server_key: "5484629bfbd2a53304ae554b2f07084a"
server_key_iv: "b7e5879ac2a39d549b263b725b54f314"
server_key_version: "encryptionkey@0"
I20260807 19:48:56.058167 22937 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:56.079646 22937 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:56.085276 22937 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:56.085669 22937 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:56.086983 22937 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:56.088634 22937 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:56.088725 22937 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:56.088918 22937 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:56.088981 22937 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:56.128300 22937 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:35451
I20260807 19:48:56.128332 23144 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:35451 every 8 connection(s)
I20260807 19:48:56.129990 22937 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:48:56.134727 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 22937
I20260807 19:48:56.134959 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:48:56.135632 12910 external_mini_cluster.cc:1428] Setting key 7eae48b1d1f88f192e847f61052d2260
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:48:56.154676 23147 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.133218 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:46059 (local address 127.12.155.190:45385)
0807 19:48:56.133847 (+ 629us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.133852 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.135168 (+ 1316us) server_negotiation.cc:407] Connection header received
0807 19:48:56.137615 (+ 2447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.137619 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.137707 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.137809 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.139871 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.140776 (+ 905us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.142666 (+ 1890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.143130 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.143239 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.147417 (+ 4178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.147423 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.147427 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.147469 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.150480 (+ 3011us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.151556 (+ 1076us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.151560 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.151562 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.151753 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.152331 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.152336 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.152338 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.152793 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.153009 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.153906 (+ 897us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.154225 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":496,"thread_start_us":332,"threads_started":1}
I20260807 19:48:56.155941 23148 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.133831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45385 (local address 127.12.155.131:46059)
0807 19:48:56.134918 (+ 1087us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:56.134986 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:56.137265 (+ 2279us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:56.138194 (+ 929us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:56.138206 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:56.138847 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:56.139639 (+ 792us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:56.139671 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.140925 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.140930 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:56.142526 (+ 1596us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:56.142542 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.143348 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.143352 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:56.143592 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.144468 (+ 876us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:56.144496 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:56.147182 (+ 2686us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:56.150668 (+ 3486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:56.150679 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:56.150704 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:56.151401 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:56.151898 (+ 497us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:56.151903 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:56.151906 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:56.152194 (+ 288us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:56.152932 (+ 738us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:56.152942 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:56.153434 (+ 492us) client_negotiation.cc:769] Sending connection context
0807 19:48:56.153779 (+ 345us) client_negotiation.cc:240] Negotiation successful
0807 19:48:56.154526 (+ 747us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":398,"threads_started":1}
I20260807 19:48:56.157562 23145 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45385
I20260807 19:48:56.157958 23145 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:56.158981 23145 heartbeater.cc:511] Master 127.12.155.190:45385 requested a full tablet report, sending...
I20260807 19:48:56.160890 22372 ts_manager.cc:194] Registered new tserver with Master: 6ea8fb151568402d9de8e475e4f65bb5 (127.12.155.131:35451)
I20260807 19:48:56.161831 22372 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:46059
I20260807 19:48:56.165529 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal test-admin with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/test-admin.keytab.
Entry for principal test-admin with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/test-admin.keytab.
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.205189 12910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
W20260807 19:48:56.212929 23155 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:56.209473 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41328 (local address 127.12.155.129:34861)
0807 19:48:56.210381 (+ 908us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.210398 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.210437 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:48:56.210537 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.210546 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.210844 (+ 298us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.211032 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.212298 (+ 1266us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41328: BlockingRecv error: recv got EOF from 127.0.0.1:41328 (error 108)
Metrics: {"server-negotiator.queue_time_us":704,"thread_start_us":431,"threads_started":1}
W20260807 19:48:56.213039 12910 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc' of type FILE
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.215164 12910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.216661 12910 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:56.235110 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.218842 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41338 (local address 127.12.155.129:34861)
0807 19:48:56.219091 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.219099 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.219295 (+ 196us) server_negotiation.cc:407] Connection header received
0807 19:48:56.219547 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.219554 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.219643 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.219766 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.220879 (+ 1113us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.222004 (+ 1125us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.223449 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.224142 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.224294 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.228571 (+ 4277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.228586 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.228608 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.228659 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.231794 (+ 3135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.232580 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.232589 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.232592 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.232737 (+ 145us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.233149 (+ 412us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.233154 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.233159 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.233625 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.233989 (+ 364us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.234471 (+ 482us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.234780 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 19:48:56.242445 23155 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:56.240303 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41340 (local address 127.12.155.129:34861)
0807 19:48:56.240568 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.240574 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.240766 (+ 192us) server_negotiation.cc:407] Connection header received
0807 19:48:56.241023 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.241028 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.241122 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.241232 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.242110 (+ 878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41340: BlockingRecv error: recv got EOF from 127.0.0.1:41340 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
W20260807 19:48:56.242594 12910 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc' of type FILE
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.244349 12910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.245800 12910 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:56.262552 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.247395 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41346 (local address 127.12.155.129:34861)
0807 19:48:56.247623 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.247629 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.247907 (+ 278us) server_negotiation.cc:407] Connection header received
0807 19:48:56.248130 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.248135 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.248198 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.248309 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.249292 (+ 983us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.250116 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.251391 (+ 1275us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.251860 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.252034 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.256235 (+ 4201us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.256243 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.256246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.256289 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.259370 (+ 3081us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.260162 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.260171 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.260179 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.260331 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.260750 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.260755 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.260759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.261075 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.261389 (+ 314us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.261708 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.261957 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 19:48:56.268078 23155 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:48:56.265880 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41362 (local address 127.12.155.129:34861)
0807 19:48:56.266171 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.266181 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.266542 (+ 361us) server_negotiation.cc:407] Connection header received
0807 19:48:56.266677 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.266681 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.266762 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.266864 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.267723 (+ 859us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:41362: BlockingRecv error: recv got EOF from 127.0.0.1:41362 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
W20260807 19:48:56.268184 12910 init.cc:300] Could not find kerberos principal in credential cache '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestCorruptKerberosCC.1786132073392555-12910-0/krb5kdc/krb5cc' of type FILE
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.270159 12910 init.cc:377] Logged in from keytab as test-admin@KRBTEST.COM (short username test-admin)
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:56.271721 12910 init.cc:295] Successfully reacquired a new kerberos TGT
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:48:56.288024 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.273273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41370 (local address 127.12.155.129:34861)
0807 19:48:56.273533 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.273540 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.273824 (+ 284us) server_negotiation.cc:407] Connection header received
0807 19:48:56.273897 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.273901 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.273970 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.274104 (+ 134us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.275093 (+ 989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.276119 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.277387 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.277892 (+ 505us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.278001 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.282193 (+ 4192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.282198 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.282201 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.282254 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.285230 (+ 2976us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.285853 (+ 623us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.285858 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.285861 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.286027 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.286457 (+ 430us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.286462 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.286464 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.286814 (+ 350us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.287099 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.287334 (+ 235us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.287610 (+ 276us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 19:48:56.290354 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 22481
I20260807 19:48:56.304608 23155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.291315 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41382 (local address 127.12.155.129:34861)
0807 19:48:56.291484 (+ 169us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.291489 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.291980 (+ 491us) server_negotiation.cc:407] Connection header received
0807 19:48:56.292123 (+ 143us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.292127 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.292193 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.292278 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.293378 (+ 1100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.294257 (+ 879us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.295601 (+ 1344us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.296153 (+ 552us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.296292 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.298704 (+ 2412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.298710 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.298714 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.298773 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.301877 (+ 3104us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.302629 (+ 752us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.302634 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.302637 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.302813 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.303162 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.303165 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.303168 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.303504 (+ 336us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.303755 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.304101 (+ 346us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.304295 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:48:56.305353 22681 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:56.397650 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 22481
I20260807 19:48:56.430707 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 22697
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:48:56.448541 23173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.431933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37976 (local address 127.12.155.130:43007)
0807 19:48:56.432611 (+ 678us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.432620 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.432654 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:48:56.432754 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.432762 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.433062 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.433222 (+ 160us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.434403 (+ 1181us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.435508 (+ 1105us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.436793 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.437435 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.437531 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.442101 (+ 4570us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.442124 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.442149 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.442191 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.445297 (+ 3106us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.446106 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.446118 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.446122 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.446270 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.446697 (+ 427us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.446703 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.446706 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.447132 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.447499 (+ 367us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.447844 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.448169 (+ 325us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":488,"thread_start_us":345,"threads_started":1}
I20260807 19:48:56.450258 22914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:56.542299 22923 heartbeater.cc:503] Master 127.12.155.190:45385 was elected leader, sending a full tablet report...
I20260807 19:48:56.543704 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 22697
W20260807 19:48:56.574914 22352 connection.cc:535] server connection from 127.12.155.130:34507 recv error: Network error: recv error from unknown peer: Transport endpoint is not connected (error 107)
I20260807 19:48:56.575332 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 22937
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[22306](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132136, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:48:56.598801 23177 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:56.576703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58804 (local address 127.12.155.131:35451)
0807 19:48:56.577498 (+ 795us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:56.577508 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:56.577550 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:48:56.577635 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:56.577643 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:56.578015 (+ 372us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:56.578255 (+ 240us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:56.579463 (+ 1208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.580964 (+ 1501us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.582515 (+ 1551us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:56.583492 (+ 977us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:56.583643 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:56.590387 (+ 6744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:56.590415 (+ 28us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:56.590447 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:56.590516 (+ 69us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:56.594902 (+ 4386us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.595928 (+ 1026us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.595939 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.595941 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.596111 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:56.596667 (+ 556us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:56.596676 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:56.596685 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:56.597173 (+ 488us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:56.597595 (+ 422us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:56.597987 (+ 392us) server_negotiation.cc:299] Negotiation successful
0807 19:48:56.598374 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":373,"threads_started":1}
I20260807 19:48:56.600711 23136 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:56.692276 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 22937
I20260807 19:48:56.718777 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 22322
I20260807 19:48:56.720497 22427 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:48:56.842360 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 22322
2026-08-07T19:48:56Z chronyd exiting
[ OK ] SecurityITest.TestCorruptKerberosCC (5189 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipalMultipleMaster
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[23183](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[23183](info): set up 2 sockets
Aug 07 19:48:56 dist-test-slave-2p8l krb5kdc[23183](info): commencing operation
krb5kdc: starting...
W20260807 19:48:58.314342 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.413s user 0.002s sys 0.036s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:48:58 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:48:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:48:58Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab.
Entry for principal oryx/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab.
I20260807 19:48:58.624048 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:44549
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab
--principal=oryx/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:44549
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:59.043253 23202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:59.043637 23202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:59.043738 23202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:59.055137 23202 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:48:59.055351 23202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:59.055456 23202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:59.055552 23202 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:48:59.055641 23202 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:48:59.067726 23202 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:44549
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab
--principal=oryx/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:44549
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:59.069631 23202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:59.071473 23202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:59.086006 23212 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:59.086033 23210 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:59.086475 23209 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:59.087026 23202 server_base.cc:1034] running on GCE node
I20260807 19:48:59.088106 23202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:59.089987 23202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:59.091300 23202 hybrid_clock.cc:648] HybridClock initialized: now 1786132139091249 us; error 33 us; skew 500 ppm
I20260807 19:48:59.091771 23202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:59 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132139, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:59.095611 23202 init.cc:377] Logged in from keytab as oryx/127.12.155.190@KRBTEST.COM (short username oryx)
I20260807 19:48:59.097311 23202 webserver.cc:460] Webserver started at http://127.12.155.190:45409/ using document root <none> and password file <none>
I20260807 19:48:59.098275 23202 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:59.098429 23202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:59.098816 23202 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:59.102653 23202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "25e97a7361944c7394809e39705da6d6"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "c4e62aee01ccbc91d94ba1b6b24b9a3d"
server_key_iv: "418bc61674181a018934d0904ebfee7d"
server_key_version: "encryptionkey@0"
I20260807 19:48:59.103605 23202 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "25e97a7361944c7394809e39705da6d6"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "c4e62aee01ccbc91d94ba1b6b24b9a3d"
server_key_iv: "418bc61674181a018934d0904ebfee7d"
server_key_version: "encryptionkey@0"
I20260807 19:48:59.110338 23202 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.003s
I20260807 19:48:59.115062 23220 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:59.116916 23202 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:48:59.117165 23202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "25e97a7361944c7394809e39705da6d6"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "c4e62aee01ccbc91d94ba1b6b24b9a3d"
server_key_iv: "418bc61674181a018934d0904ebfee7d"
server_key_version: "encryptionkey@0"
I20260807 19:48:59.117408 23202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:59.139653 23202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:59.145553 23202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:59.146021 23202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:59.168931 23202 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:44549
I20260807 19:48:59.169081 23303 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:44549 every 8 connection(s)
I20260807 19:48:59.170775 23202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:48:59.175599 23304 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:48:59.179812 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 23202
I20260807 19:48:59.180074 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:48:59.181080 12910 external_mini_cluster.cc:1428] Setting key eecc00c42be696bbf3618b9c9861b017
I20260807 19:48:59.192159 23304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Bootstrap starting.
I20260807 19:48:59.197132 23304 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Neither blocks nor log segments found. Creating new log.
I20260807 19:48:59.198829 23304 log.cc:824] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:48:59 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:48:59.202709 23304 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: No bootstrap required, opened a new log
I20260807 19:48:59.210539 23312 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:59.184048 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42880 (local address 127.12.155.190:44549)
0807 19:48:59.185085 (+ 1037us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:59.185101 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:59.185161 (+ 60us) server_negotiation.cc:407] Connection header received
0807 19:48:59.187184 (+ 2023us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:59.187218 (+ 34us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:59.187780 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:59.188217 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:59.190533 (+ 2316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:59.192091 (+ 1558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:59.193963 (+ 1872us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:59.194795 (+ 832us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:59.194966 (+ 171us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:59.200708 (+ 5742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:59.200718 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:59.200740 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:59.200796 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:59.205116 (+ 4320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:59.205952 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:59.205962 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:59.205972 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:59.206251 (+ 279us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:59.206665 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:59.206670 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:59.206674 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:59.207527 (+ 853us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:59.207897 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:59.208255 (+ 358us) server_negotiation.cc:299] Negotiation successful
0807 19:48:59.208796 (+ 541us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":768,"thread_start_us":483,"threads_started":1}
I20260807 19:48:59.214118 23304 raft_consensus.cc:348] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } }
I20260807 19:48:59.214634 23304 raft_consensus.cc:374] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:48:59.214754 23304 raft_consensus.cc:729] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 25e97a7361944c7394809e39705da6d6, State: Initialized, Role: FOLLOWER
I20260807 19:48:59.215490 23304 consensus_queue.cc:260] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } }
I20260807 19:48:59.215746 23304 raft_consensus.cc:388] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:48:59.215909 23304 raft_consensus.cc:482] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:48:59.216097 23304 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:48:59.218729 23304 raft_consensus.cc:504] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } }
I20260807 19:48:59.219481 23304 leader_election.cc:302] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 25e97a7361944c7394809e39705da6d6; no voters:
I20260807 19:48:59.220206 23304 leader_election.cc:288] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:48:59.220405 23315 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:48:59.221274 23315 raft_consensus.cc:686] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 LEADER]: Becoming Leader. State: Replica: 25e97a7361944c7394809e39705da6d6, State: Running, Role: LEADER
I20260807 19:48:59.221903 23315 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } }
I20260807 19:48:59.222956 23304 sys_catalog.cc:564] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:48:59.225550 23319 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } }
I20260807 19:48:59.225498 23320 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e97a7361944c7394809e39705da6d6. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } }
I20260807 19:48:59.225957 23319 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:59.226003 23320 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:48:59.227125 23325 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:48:59.234938 23325 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:48:59.241627 23346 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:48:59.248428 23325 catalog_manager.cc:1347] Generated new cluster ID: 1ca527124c05406588dac8e36701c2f9
I20260807 19:48:59.248577 23325 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:48:59.258315 23325 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:48:59.260902 23325 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:48:59.277755 23325 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Generated new TSK 0
I20260807 19:48:59.280033 23325 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab.
Entry for principal oryx/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab.
I20260807 19:48:59.370359 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44549
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:48:59.821187 23355 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:48:59.821589 23355 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:48:59.821761 23355 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:48:59.830448 23355 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:48:59.830607 23355 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:48:59.830799 23355 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:48:59.841851 23355 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:48:59.843675 23355 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:48:59.845458 23355 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:48:59.861778 23363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:59.861670 23364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:48:59.861631 23367 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:48:59.862953 23355 server_base.cc:1034] running on GCE node
I20260807 19:48:59.863731 23355 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:48:59.864955 23355 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:48:59.866189 23355 hybrid_clock.cc:648] HybridClock initialized: now 1786132139866122 us; error 70 us; skew 500 ppm
I20260807 19:48:59.866611 23355 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:48:59 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132139, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:48:59.870651 23355 init.cc:377] Logged in from keytab as oryx/127.12.155.129@KRBTEST.COM (short username oryx)
I20260807 19:48:59.872582 23355 webserver.cc:460] Webserver started at http://127.12.155.129:33733/ using document root <none> and password file <none>
I20260807 19:48:59.873469 23355 fs_manager.cc:359] Metadata directory not provided
I20260807 19:48:59.873634 23355 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:48:59.874008 23355 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:48:59.877628 23355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "0a968bf47dde475794cf3d231c9ecb58"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "0ff62b23fb247686f63ec7f124c50a20"
server_key_iv: "6c6f27fce6fb21ca163eeb59941494b9"
server_key_version: "encryptionkey@0"
I20260807 19:48:59.878574 23355 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "0a968bf47dde475794cf3d231c9ecb58"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "0ff62b23fb247686f63ec7f124c50a20"
server_key_iv: "6c6f27fce6fb21ca163eeb59941494b9"
server_key_version: "encryptionkey@0"
I20260807 19:48:59.885069 23355 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:48:59.889321 23379 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:59.891148 23355 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.002s
I20260807 19:48:59.891326 23355 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "0a968bf47dde475794cf3d231c9ecb58"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "0ff62b23fb247686f63ec7f124c50a20"
server_key_iv: "6c6f27fce6fb21ca163eeb59941494b9"
server_key_version: "encryptionkey@0"
I20260807 19:48:59.891525 23355 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:48:59.913209 23355 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:48:59.918090 23355 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:48:59.918387 23355 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:48:59.919492 23355 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:48:59.921207 23355 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:48:59.921339 23355 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:59.921481 23355 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:48:59.921531 23355 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:48:59.964928 23355 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:45995
I20260807 19:48:59.965037 23563 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:45995 every 8 connection(s)
I20260807 19:48:59.966717 23355 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:48:59.972582 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 23355
I20260807 19:48:59.972843 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:48:59.973563 12910 external_mini_cluster.cc:1428] Setting key 25dc0109d10e5cacdc14eddb0eef200a
Aug 07 19:48:59 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132139, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:48:59.991667 23569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:59.970195 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:56999 (local address 127.12.155.190:44549)
0807 19:48:59.970834 (+ 639us) server_negotiation.cc:206] Beginning negotiation
0807 19:48:59.970841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:48:59.971907 (+ 1066us) server_negotiation.cc:407] Connection header received
0807 19:48:59.974364 (+ 2457us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:48:59.974371 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:48:59.974502 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:48:59.974651 (+ 149us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:48:59.976607 (+ 1956us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:59.977480 (+ 873us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:59.979415 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:48:59.979904 (+ 489us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:48:59.980053 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:59.984743 (+ 4690us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:48:59.984754 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:48:59.984760 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:48:59.984821 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:48:59.987995 (+ 3174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:59.988877 (+ 882us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:59.988883 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:59.988887 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:59.989035 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:48:59.989512 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:48:59.989516 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:48:59.989518 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:48:59.989859 (+ 341us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:48:59.990027 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 19:48:59.990939 (+ 912us) server_negotiation.cc:299] Negotiation successful
0807 19:48:59.991225 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":481,"thread_start_us":331,"threads_started":1}
I20260807 19:48:59.992988 23570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:48:59.970745 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:56999)
0807 19:48:59.971661 (+ 916us) negotiation.cc:107] Waiting for socket to connect
0807 19:48:59.971716 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:48:59.973959 (+ 2243us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:48:59.974957 (+ 998us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:48:59.974968 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:48:59.975642 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:48:59.976396 (+ 754us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:59.976418 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:59.977666 (+ 1248us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:59.977671 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:59.979239 (+ 1568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:48:59.979253 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:48:59.980195 (+ 942us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:48:59.980203 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:48:59.980486 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:48:59.981384 (+ 898us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:48:59.981418 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:48:59.984421 (+ 3003us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:48:59.988210 (+ 3789us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:59.988230 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:59.988249 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:59.988735 (+ 486us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:59.989151 (+ 416us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:48:59.989157 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:48:59.989161 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:48:59.989381 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:48:59.989996 (+ 615us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:48:59.990005 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:48:59.990496 (+ 491us) client_negotiation.cc:769] Sending connection context
0807 19:48:59.990828 (+ 332us) client_negotiation.cc:240] Negotiation successful
0807 19:48:59.991523 (+ 695us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":630,"thread_start_us":318,"threads_started":1}
I20260807 19:48:59.995005 23564 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44549
I20260807 19:48:59.995415 23564 heartbeater.cc:464] Registering TS with master...
I20260807 19:48:59.996417 23564 heartbeater.cc:511] Master 127.12.155.190:44549 requested a full tablet report, sending...
I20260807 19:48:59.999379 23252 ts_manager.cc:194] Registered new tserver with Master: 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995)
I20260807 19:49:00.002352 23252 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:56999
WARNING: no policy specified for oryx/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab.
Entry for principal oryx/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab.
I20260807 19:49:00.046255 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44549
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:00.461405 23573 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:00.461792 23573 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:00.461946 23573 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:00.470089 23573 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:00.470247 23573 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:00.470441 23573 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:00.481570 23573 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:00.483688 23573 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:00.485493 23573 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:00.502647 23579 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:00.503152 23580 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:00.503566 23583 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:00.504376 23573 server_base.cc:1034] running on GCE node
I20260807 19:49:00.505185 23573 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:00.506521 23573 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:00.507762 23573 hybrid_clock.cc:648] HybridClock initialized: now 1786132140507716 us; error 54 us; skew 500 ppm
I20260807 19:49:00.508148 23573 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:00 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132140, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:00.512190 23573 init.cc:377] Logged in from keytab as oryx/127.12.155.130@KRBTEST.COM (short username oryx)
I20260807 19:49:00.514053 23573 webserver.cc:460] Webserver started at http://127.12.155.130:38577/ using document root <none> and password file <none>
I20260807 19:49:00.515027 23573 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:00.515187 23573 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:00.515556 23573 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:00.519307 23573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "fc57c251e3044bd79497324d416183d5"
format_stamp: "Formatted at 2026-08-07 19:49:00 on dist-test-slave-2p8l"
server_key: "482884f418a89346a96f5e4269e6db49"
server_key_iv: "9ac576b2db407501e1bdb94d7a868711"
server_key_version: "encryptionkey@0"
I20260807 19:49:00.520346 23573 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "fc57c251e3044bd79497324d416183d5"
format_stamp: "Formatted at 2026-08-07 19:49:00 on dist-test-slave-2p8l"
server_key: "482884f418a89346a96f5e4269e6db49"
server_key_iv: "9ac576b2db407501e1bdb94d7a868711"
server_key_version: "encryptionkey@0"
I20260807 19:49:00.528287 23573 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 19:49:00.536301 23597 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:00.538486 23573 fs_manager.cc:725] Time spent opening block manager: real 0.007s user 0.006s sys 0.000s
I20260807 19:49:00.538725 23573 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "fc57c251e3044bd79497324d416183d5"
format_stamp: "Formatted at 2026-08-07 19:49:00 on dist-test-slave-2p8l"
server_key: "482884f418a89346a96f5e4269e6db49"
server_key_iv: "9ac576b2db407501e1bdb94d7a868711"
server_key_version: "encryptionkey@0"
I20260807 19:49:00.539065 23573 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:00.560200 23573 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:00.565744 23573 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:00.566141 23573 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:00.567405 23573 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:00.569087 23573 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:00.569168 23573 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:00.569270 23573 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:00.569322 23573 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:00.608697 23573 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:36363
I20260807 19:49:00.608821 23778 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:36363 every 8 connection(s)
I20260807 19:49:00.610416 23573 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:00.612154 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 23573
I20260807 19:49:00.612390 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:49:00.613042 12910 external_mini_cluster.cc:1428] Setting key 6202aede3282b96c8345746843ccf163
Aug 07 19:49:00 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132140, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:00.638617 23782 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:00.614156 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:50575 (local address 127.12.155.190:44549)
0807 19:49:00.618499 (+ 4343us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:00.618509 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:00.618536 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:49:00.618614 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:00.618619 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:00.618739 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:00.618880 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:00.620806 (+ 1926us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:00.621647 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:00.623636 (+ 1989us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:00.624194 (+ 558us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:00.624356 (+ 162us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:00.629616 (+ 5260us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:00.629627 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:00.629636 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:00.629697 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:00.634343 (+ 4646us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:00.635327 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:00.635338 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:00.635345 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:00.635533 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:00.636000 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:00.636008 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:00.636015 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:00.636542 (+ 527us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:00.636728 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:00.637650 (+ 922us) server_negotiation.cc:299] Negotiation successful
0807 19:49:00.637983 (+ 333us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4178,"thread_start_us":4047,"threads_started":1}
I20260807 19:49:00.639541 23783 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:00.614865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:50575)
0807 19:49:00.616132 (+ 1267us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:00.616190 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:00.618277 (+ 2087us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:00.619186 (+ 909us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:00.619196 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:00.619834 (+ 638us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:00.620569 (+ 735us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:00.620590 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:00.621857 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:00.621862 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:00.623475 (+ 1613us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:00.623489 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:00.624548 (+ 1059us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:00.624559 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:00.624976 (+ 417us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:00.625961 (+ 985us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:00.626000 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:00.629323 (+ 3323us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:00.634529 (+ 5206us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:00.634539 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:00.634559 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:00.635137 (+ 578us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:00.635651 (+ 514us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:00.635654 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:00.635656 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:00.635865 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:00.636702 (+ 837us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:00.636710 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:00.637183 (+ 473us) client_negotiation.cc:769] Sending connection context
0807 19:49:00.637475 (+ 292us) client_negotiation.cc:240] Negotiation successful
0807 19:49:00.637996 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":911,"thread_start_us":436,"threads_started":1}
I20260807 19:49:00.641480 23780 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44549
I20260807 19:49:00.641867 23780 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:00.642860 23780 heartbeater.cc:511] Master 127.12.155.190:44549 requested a full tablet report, sending...
I20260807 19:49:00.645110 23252 ts_manager.cc:194] Registered new tserver with Master: fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363)
I20260807 19:49:00.646481 23252 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:50575
WARNING: no policy specified for oryx/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab.
Entry for principal oryx/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab.
I20260807 19:49:00.690444 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44549
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:01.007179 23564 heartbeater.cc:503] Master 127.12.155.190:44549 was elected leader, sending a full tablet report...
W20260807 19:49:01.101171 23793 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:01.101606 23793 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:01.101774 23793 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:01.109856 23793 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:01.110016 23793 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:01.110286 23793 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:01.121485 23793 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:44549
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:01.123517 23793 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:01.125309 23793 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:01.141821 23800 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:01.141795 23803 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:01.141745 23805 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:01.143383 23793 server_base.cc:1034] running on GCE node
I20260807 19:49:01.144244 23793 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:01.145578 23793 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:01.146824 23793 hybrid_clock.cc:648] HybridClock initialized: now 1786132141146773 us; error 44 us; skew 500 ppm
I20260807 19:49:01.147207 23793 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:01 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132141, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:01.156770 23793 init.cc:377] Logged in from keytab as oryx/127.12.155.131@KRBTEST.COM (short username oryx)
I20260807 19:49:01.158866 23793 webserver.cc:460] Webserver started at http://127.12.155.131:37677/ using document root <none> and password file <none>
I20260807 19:49:01.159785 23793 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:01.159947 23793 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:01.160315 23793 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:01.163996 23793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "a9357ed3544e471f8223ce65a096c934"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "74368bf413a1fd476f99e793ecf8a58c"
server_key_iv: "86e999f5839b8769ffd19528130b88a3"
server_key_version: "encryptionkey@0"
I20260807 19:49:01.164901 23793 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "a9357ed3544e471f8223ce65a096c934"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "74368bf413a1fd476f99e793ecf8a58c"
server_key_iv: "86e999f5839b8769ffd19528130b88a3"
server_key_version: "encryptionkey@0"
I20260807 19:49:01.171155 23793 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.004s
I20260807 19:49:01.175402 23818 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:01.177179 23793 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:49:01.177352 23793 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "a9357ed3544e471f8223ce65a096c934"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "74368bf413a1fd476f99e793ecf8a58c"
server_key_iv: "86e999f5839b8769ffd19528130b88a3"
server_key_version: "encryptionkey@0"
I20260807 19:49:01.177565 23793 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:01.201973 23793 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:01.206734 23793 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:01.207031 23793 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:01.208153 23793 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:01.209789 23793 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:01.209873 23793 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:01.209973 23793 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:01.210021 23793 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:01.251646 23793 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:35151
I20260807 19:49:01.251690 24023 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:35151 every 8 connection(s)
I20260807 19:49:01.253373 23793 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:01.255041 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 23793
I20260807 19:49:01.255286 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:49:01.255992 12910 external_mini_cluster.cc:1428] Setting key 5e1ca1de398bd76d45b3cdb9c6d28fa6
Aug 07 19:49:01 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132141, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:01.276973 24030 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.257041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:42135 (local address 127.12.155.190:44549)
0807 19:49:01.257713 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:01.257721 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:01.259131 (+ 1410us) server_negotiation.cc:407] Connection header received
0807 19:49:01.261433 (+ 2302us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:01.261439 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:01.261557 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:01.261686 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:01.263536 (+ 1850us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.264384 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.266087 (+ 1703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.266552 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.266692 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.270835 (+ 4143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:01.270841 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:01.270845 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:01.270884 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:01.273928 (+ 3044us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.274739 (+ 811us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.274743 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.274746 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.274894 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.275288 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.275292 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.275294 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.275601 (+ 307us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:01.275728 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:01.276455 (+ 727us) server_negotiation.cc:299] Negotiation successful
0807 19:49:01.276650 (+ 195us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":498,"thread_start_us":338,"threads_started":1}
I20260807 19:49:01.278512 24032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.257874 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:42135)
0807 19:49:01.258958 (+ 1084us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:01.259006 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:01.261130 (+ 2124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:01.261977 (+ 847us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:01.261987 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:01.262664 (+ 677us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:01.263343 (+ 679us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:01.263364 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.264564 (+ 1200us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.264568 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:01.265906 (+ 1338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:01.265919 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.266809 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.266816 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:01.267065 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.267897 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:01.267926 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:01.270575 (+ 2649us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:01.274113 (+ 3538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:01.274123 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:01.274147 (+ 24us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:01.274622 (+ 475us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:01.274989 (+ 367us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:01.274993 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:01.274996 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:01.275191 (+ 195us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:01.275707 (+ 516us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:01.275714 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:01.276106 (+ 392us) client_negotiation.cc:769] Sending connection context
0807 19:49:01.276361 (+ 255us) client_negotiation.cc:240] Negotiation successful
0807 19:49:01.276868 (+ 507us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":722,"thread_start_us":449,"threads_started":1}
I20260807 19:49:01.280112 24024 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44549
I20260807 19:49:01.280505 24024 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:01.281486 24024 heartbeater.cc:511] Master 127.12.155.190:44549 requested a full tablet report, sending...
I20260807 19:49:01.283298 23252 ts_manager.cc:194] Registered new tserver with Master: a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:01.284446 23252 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:42135
I20260807 19:49:01.285627 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.155.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.189.keytab.
Entry for principal oryx/127.12.155.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.189.keytab.
I20260807 19:49:01.355938 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:35731
--webserver_interface=127.12.155.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.189.keytab
--principal=oryx/127.12.155.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:44549,127.12.155.189:35731
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:01.649948 23780 heartbeater.cc:503] Master 127.12.155.190:44549 was elected leader, sending a full tablet report...
W20260807 19:49:01.778021 24035 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:01.778573 24035 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:01.778743 24035 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:01.787312 24035 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:01.787513 24035 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:01.787624 24035 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:01.787734 24035 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:01.787812 24035 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:01.800647 24035 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:44549,127.12.155.189:35731
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.189.keytab
--principal=oryx/127.12.155.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:35731
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.155.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
W20260807 19:49:01.801204 24035 master_options.cc:55] Only 2 masters are specified by master_addresses_flag ('127.12.155.190:44549,127.12.155.189:35731'), but minimum of 3 are required to tolerate failures of any one master. It is recommended to use at least 3 masters.
I20260807 19:49:01.802805 24035 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:01.804553 24035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:01.819849 24045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:01.819906 24043 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:01.819739 24048 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:01.821506 24035 server_base.cc:1034] running on GCE node
I20260807 19:49:01.822911 24035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:01.825089 24035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:01.826391 24035 hybrid_clock.cc:648] HybridClock initialized: now 1786132141826316 us; error 66 us; skew 500 ppm
I20260807 19:49:01.826926 24035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:01 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132141, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:01.831409 24035 init.cc:377] Logged in from keytab as oryx/127.12.155.189@KRBTEST.COM (short username oryx)
I20260807 19:49:01.833340 24035 webserver.cc:460] Webserver started at http://127.12.155.189:38079/ using document root <none> and password file <none>
I20260807 19:49:01.834373 24035 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:01.834519 24035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:01.834930 24035 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:01.838990 24035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/instance:
uuid: "a26b1f181f7c4eed8c88556fb8331580"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "a0319cb324c09f99605d5459d954ceb9"
server_key_iv: "da8c54dd334db122fa0dd35026bc01bd"
server_key_version: "encryptionkey@0"
I20260807 19:49:01.840060 24035 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal/instance:
uuid: "a26b1f181f7c4eed8c88556fb8331580"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "a0319cb324c09f99605d5459d954ceb9"
server_key_iv: "da8c54dd334db122fa0dd35026bc01bd"
server_key_version: "encryptionkey@0"
I20260807 19:49:01.847494 24035 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 19:49:01.852430 24064 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:01.854493 24035 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:49:01.854759 24035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
uuid: "a26b1f181f7c4eed8c88556fb8331580"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "a0319cb324c09f99605d5459d954ceb9"
server_key_iv: "da8c54dd334db122fa0dd35026bc01bd"
server_key_version: "encryptionkey@0"
I20260807 19:49:01.855109 24035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:01.895177 24035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:01.901268 24035 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:01.901597 24035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:01.924536 24035 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.189:35731
I20260807 19:49:01.924578 24145 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.189:35731 every 8 connection(s)
I20260807 19:49:01.926501 24035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
I20260807 19:49:01.930450 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 24035
I20260807 19:49:01.932331 24146 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:01.943197 24146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:49:01 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
Aug 07 19:49:01 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132141, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.189@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:01.961524 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.933558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60410 (local address 127.12.155.189:35731)
0807 19:49:01.934611 (+ 1053us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:01.934627 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:01.934680 (+ 53us) server_negotiation.cc:407] Connection header received
0807 19:49:01.936557 (+ 1877us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:01.936588 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:01.937118 (+ 530us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:01.937622 (+ 504us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:01.939453 (+ 1831us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.941003 (+ 1550us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.942406 (+ 1403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.943165 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.943377 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.951154 (+ 7777us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:01.951165 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:01.951178 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:01.951222 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:01.955341 (+ 4119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.956638 (+ 1297us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.956647 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.956656 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.956889 (+ 233us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.957377 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.957386 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.957388 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.958106 (+ 718us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:01.958486 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:01.959074 (+ 588us) server_negotiation.cc:299] Negotiation successful
0807 19:49:01.959637 (+ 563us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":795,"thread_start_us":509,"threads_started":1}
I20260807 19:49:01.967948 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.946740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42894 (local address 127.12.155.190:44549)
0807 19:49:01.948932 (+ 2192us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:01.948940 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:01.948964 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:49:01.949046 (+ 82us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:01.949052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:01.949177 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:01.949345 (+ 168us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:01.951666 (+ 2321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.952975 (+ 1309us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.954981 (+ 2006us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.955693 (+ 712us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.955811 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.959983 (+ 4172us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:01.959990 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:01.959995 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:01.960059 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:01.963744 (+ 3685us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.964893 (+ 1149us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.964900 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.964903 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.965104 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.965706 (+ 602us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.965714 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.965717 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.966275 (+ 558us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:01.966494 (+ 219us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:01.967101 (+ 607us) server_negotiation.cc:299] Negotiation successful
0807 19:49:01.967408 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2012,"thread_start_us":1869,"threads_started":1}
I20260807 19:49:01.967989 24154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.946643 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:42894)
0807 19:49:01.948085 (+ 1442us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:01.948187 (+ 102us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:01.948440 (+ 253us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:01.949749 (+ 1309us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:01.949758 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:01.951039 (+ 1281us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:01.951453 (+ 414us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:01.951465 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.953229 (+ 1764us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.953251 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:01.954790 (+ 1539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:01.954810 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.955948 (+ 1138us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.955956 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:01.956191 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.957068 (+ 877us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:01.957087 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:01.959725 (+ 2638us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:01.963928 (+ 4203us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:01.963940 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:01.963949 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:01.964726 (+ 777us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:01.965261 (+ 535us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:01.965267 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:01.965271 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:01.965487 (+ 216us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:01.966448 (+ 961us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:01.966457 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:01.966693 (+ 236us) client_negotiation.cc:769] Sending connection context
0807 19:49:01.966960 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 19:49:01.967393 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":874,"thread_start_us":562,"threads_started":1}
I20260807 19:49:01.970122 24146 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:49:01 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132141, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.189@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
I20260807 19:49:01.984755 24154 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.971152 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:60422)
0807 19:49:01.971394 (+ 242us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:01.971416 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:01.971525 (+ 109us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:01.971799 (+ 274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:01.971802 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:01.972175 (+ 373us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:01.972331 (+ 156us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:01.972339 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.973486 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.973490 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:01.974460 (+ 970us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:01.974472 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.975198 (+ 726us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.975202 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:01.975360 (+ 158us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.975988 (+ 628us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:01.976005 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:01.978469 (+ 2464us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:01.981927 (+ 3458us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:01.981931 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:01.981934 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:01.982470 (+ 536us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:01.982901 (+ 431us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:01.982908 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:01.982912 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:01.983049 (+ 137us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:01.983644 (+ 595us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:01.983648 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:01.983826 (+ 178us) client_negotiation.cc:769] Sending connection context
0807 19:49:01.983967 (+ 141us) client_negotiation.cc:240] Negotiation successful
0807 19:49:01.984313 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":62}
I20260807 19:49:01.984828 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:01.971350 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60422 (local address 127.12.155.189:35731)
0807 19:49:01.971499 (+ 149us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:01.971503 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:01.971519 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:49:01.971603 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:01.971607 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:01.971667 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:01.971785 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:01.972455 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.973341 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.974590 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:01.975050 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:01.975156 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:01.978672 (+ 3516us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:01.978680 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:01.978693 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:01.978739 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:01.981786 (+ 3047us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.982586 (+ 800us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.982595 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.982599 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.982769 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:01.983166 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:01.983170 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:01.983172 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:01.983488 (+ 316us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:01.983694 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:01.984072 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 19:49:01.984490 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":162,"server-negotiator.queue_time_us":51}
I20260807 19:49:01.991205 24146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Bootstrap starting.
I20260807 19:49:01.995396 24146 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:01.996816 24146 log.cc:824] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:02.000291 24146 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: No bootstrap required, opened a new log
I20260807 19:49:02.008670 24146 raft_consensus.cc:348] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } }
I20260807 19:49:02.009166 24146 raft_consensus.cc:374] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:02.009287 24146 raft_consensus.cc:729] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a26b1f181f7c4eed8c88556fb8331580, State: Initialized, Role: FOLLOWER
I20260807 19:49:02.010102 24146 consensus_queue.cc:260] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } }
I20260807 19:49:02.011444 24163 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } } }
I20260807 19:49:02.011924 24163 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:02.013659 24146 sys_catalog.cc:564] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 19:49:02.025717 24179 catalog_manager.cc:1558] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:49:02.025966 24179 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:49:02.028391 24035 master_runner.cc:428] Detected that this master a26b1f181f7c4eed8c88556fb8331580 is joining an existing cluster
I20260807 19:49:02.028492 24035 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.155.189:35731
I20260807 19:49:02.050725 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.034035 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42896 (local address 127.12.155.190:44549)
0807 19:49:02.034308 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.034318 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.034599 (+ 281us) server_negotiation.cc:407] Connection header received
0807 19:49:02.034936 (+ 337us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.034943 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.035058 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.035187 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.036881 (+ 1694us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.038127 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.040201 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.040717 (+ 516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.040878 (+ 161us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.043706 (+ 2828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.043714 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.043720 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.043791 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.047395 (+ 3604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.048131 (+ 736us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.048138 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.048142 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.048347 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.048813 (+ 466us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.048822 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.048827 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.049217 (+ 390us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.049395 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.049963 (+ 568us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.050282 (+ 319us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:49:02.051126 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.034275 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60426 (local address 127.12.155.189:35731)
0807 19:49:02.034499 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.034506 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.034749 (+ 243us) server_negotiation.cc:407] Connection header received
0807 19:49:02.035396 (+ 647us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.035402 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.035488 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.035607 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.037041 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.037805 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.040015 (+ 2210us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.040762 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.040926 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.043875 (+ 2949us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.043883 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.043888 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.043934 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.048085 (+ 4151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.048879 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.048885 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.048888 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.049056 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.049480 (+ 424us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.049486 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.049489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.049801 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.049995 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.050488 (+ 493us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.050727 (+ 239us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":72}
I20260807 19:49:02.051216 24190 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.033303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:42896)
0807 19:49:02.034466 (+ 1163us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.034493 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.034749 (+ 256us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.035215 (+ 466us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.035219 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.036174 (+ 955us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.036663 (+ 489us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.036677 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.038296 (+ 1619us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.038303 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.040051 (+ 1748us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.040060 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.040924 (+ 864us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.040931 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.041304 (+ 373us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.042205 (+ 901us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.042229 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.043503 (+ 1274us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.047537 (+ 4034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.047547 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.047551 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.047999 (+ 448us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.048478 (+ 479us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.048483 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.048487 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.048679 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.049356 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.049361 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.049614 (+ 253us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.049811 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.050250 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":663,"mutex_wait_us":52,"thread_start_us":456,"threads_started":1}
I20260807 19:49:02.052175 24192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.033427 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:60426)
0807 19:49:02.034648 (+ 1221us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.034664 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.034778 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.035653 (+ 875us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.035660 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.036503 (+ 843us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.036912 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.036921 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.037974 (+ 1053us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.037979 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.039823 (+ 1844us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.039858 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.041145 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.041152 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.041361 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.042292 (+ 931us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.042318 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.043644 (+ 1326us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.048212 (+ 4568us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.048219 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.048222 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.048717 (+ 495us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.049177 (+ 460us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.049181 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.049185 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.049376 (+ 191us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.050045 (+ 669us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.050050 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.050219 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.051426 (+ 1207us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.051710 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1089,"mutex_wait_us":6,"thread_start_us":1074,"threads_started":1}
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132139, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.190@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
I20260807 19:49:02.079130 24153 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.059231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60442 (local address 127.12.155.189:35731)
0807 19:49:02.059476 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.059485 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.060169 (+ 684us) server_negotiation.cc:407] Connection header received
0807 19:49:02.060593 (+ 424us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.060600 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.060715 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.060831 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.062290 (+ 1459us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.063135 (+ 845us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.064569 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.065101 (+ 532us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.065254 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.069601 (+ 4347us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.069609 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.069613 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.069659 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.074494 (+ 4835us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.075825 (+ 1331us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.075834 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.075841 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.076167 (+ 326us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.076704 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.076712 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.076717 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.077296 (+ 579us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.077466 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.078277 (+ 811us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.078613 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:49:02.079141 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.059235 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:60442)
0807 19:49:02.059970 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.060022 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.060255 (+ 233us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.060897 (+ 642us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.060907 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.061794 (+ 887us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.062121 (+ 327us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.062142 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.063278 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.063286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.064404 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.064424 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.065281 (+ 857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.065288 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.065530 (+ 242us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.066381 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.066401 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.069413 (+ 3012us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.074754 (+ 5341us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.074786 (+ 32us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.074798 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.075653 (+ 855us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.076332 (+ 679us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.076338 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.076342 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.076568 (+ 226us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.077463 (+ 895us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.077474 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.077776 (+ 302us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.078136 (+ 360us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.078629 (+ 493us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":485,"thread_start_us":311,"threads_started":1}
I20260807 19:49:02.081946 24163 raft_consensus.cc:482] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:02.082046 23251 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.155.189:35731: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580"
member_type: NON_VOTER
last_known_addr {
host: "127.12.155.189"
port: 35731
}
attrs {
promote: true
}
}
dest_uuid: "25e97a7361944c7394809e39705da6d6"
cas_config_opid_index: -1
I20260807 19:49:02.082391 24163 raft_consensus.cc:504] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } }
I20260807 19:49:02.083561 23251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } }
I20260807 19:49:02.084262 24163 leader_election.cc:288] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549)
I20260807 19:49:02.085161 23268 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a26b1f181f7c4eed8c88556fb8331580" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "25e97a7361944c7394809e39705da6d6" is_pre_election: true
I20260807 19:49:02.086704 24069 leader_election.cc:302] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 2 responses out of 2 voters: 1 yes votes; 1 no votes. yes voters: a26b1f181f7c4eed8c88556fb8331580; no voters: 25e97a7361944c7394809e39705da6d6
I20260807 19:49:02.087234 24163 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 19:49:02.102555 24113 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:02.101853 24198 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 LEADER]: Committing config change with OpId 1.5: config changed from index -1 to 5, NON_VOTER a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189) added. New config: { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } } }
WARNING: no policy specified for oryx/127.12.155.188@KRBTEST.COM; defaulting to no policy
I20260807 19:49:02.108047 24198 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.155.189:35731
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.188@KRBTEST.COM" created.
I20260807 19:49:02.109161 24113 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Refusing update from remote peer 25e97a7361944c7394809e39705da6d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 5. (index mismatch)
I20260807 19:49:02.109258 24035 master.cc:537] Master@127.12.155.189:35731 shutting down...
I20260807 19:49:02.109213 24197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } } }
I20260807 19:49:02.109632 24197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:02.111382 24198 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:49:02.115557 23221 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master
W20260807 19:49:02.127972 23221 consensus_peers.cc:487] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 -> Peer a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189:35731): Couldn't send request to peer a26b1f181f7c4eed8c88556fb8331580. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 19:49:02.129741 24035 raft_consensus.cc:2229] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:02.130479 24035 raft_consensus.cc:2258] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:02.130718 24035 tablet_replica.cc:330] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: stopping tablet replica
I20260807 19:49:02.139180 24035 master.cc:552] Master@127.12.155.189:35731 shutdown complete.
I20260807 19:49:02.139384 24035 master_runner.cc:305] Clearing existing system tablet
I20260807 19:49:02.140005 24035 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:02.140131 24035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:02.146869 24035 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.001s sys 0.008s
I20260807 19:49:02.149089 24207 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:02.149485 24035 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:02.149760 24035 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 19:49:02.149861 24035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
uuid: "a26b1f181f7c4eed8c88556fb8331580"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "a0319cb324c09f99605d5459d954ceb9"
server_key_iv: "da8c54dd334db122fa0dd35026bc01bd"
server_key_version: "encryptionkey@0"
I20260807 19:49:02.155191 24035 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Deleting tablet data with delete state TABLET_DATA_DELETED
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.188.keytab.
Entry for principal oryx/127.12.155.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.188.keytab.
I20260807 19:49:02.158818 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:38351
--webserver_interface=127.12.155.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.188.keytab
--principal=oryx/127.12.155.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:02.163550 24035 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 19:49:02.163782 24035 log.cc:1196] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal/wals/00000000000000000000000000000000
I20260807 19:49:02.164366 24035 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Deleting consensus metadata
I20260807 19:49:02.164718 24035 master_runner.cc:315] Copying system tablet from 127.12.155.190:44549
I20260807 19:49:02.168001 24035 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: tablet copy: Beginning tablet copy session from remote peer at address 127.12.155.190:44549
I20260807 19:49:02.197072 24158 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.169609 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42908 (local address 127.12.155.190:44549)
0807 19:49:02.169857 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.169867 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.174892 (+ 5025us) server_negotiation.cc:407] Connection header received
0807 19:49:02.175280 (+ 388us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.175289 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.175404 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.175499 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.177095 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.178518 (+ 1423us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.184161 (+ 5643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.185050 (+ 889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.185180 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.188592 (+ 3412us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.188602 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.188610 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.188666 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.193268 (+ 4602us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.194241 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.194251 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.194256 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.194459 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.194958 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.194967 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.194972 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.195469 (+ 497us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.195667 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.196239 (+ 572us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.196544 (+ 305us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:49:02.197125 24216 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.169064 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:42908)
0807 19:49:02.174708 (+ 5644us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.174737 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.175068 (+ 331us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.175785 (+ 717us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.175791 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.176495 (+ 704us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.176873 (+ 378us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.176892 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.181891 (+ 4999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.181909 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.183959 (+ 2050us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.183980 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.185571 (+ 1591us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.185579 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.185819 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.186807 (+ 988us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.186839 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.188320 (+ 1481us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.193437 (+ 5117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.193445 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.193450 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.194050 (+ 600us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.194594 (+ 544us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.194599 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.194602 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.194822 (+ 220us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.195614 (+ 792us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.195620 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.195830 (+ 210us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.196068 (+ 238us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.196613 (+ 545us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5453,"thread_start_us":5262,"threads_started":1}
I20260807 19:49:02.198659 23282 tablet_copy_service.cc:140] P 25e97a7361944c7394809e39705da6d6: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer a26b1f181f7c4eed8c88556fb8331580 ({username='oryx', principal='oryx/127.12.155.189@KRBTEST.COM'} at 127.0.0.1:42908)
I20260807 19:49:02.199088 23282 tablet_copy_service.cc:161] P 25e97a7361944c7394809e39705da6d6: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer a26b1f181f7c4eed8c88556fb8331580 at {username='oryx', principal='oryx/127.12.155.189@KRBTEST.COM'} at 127.0.0.1:42908: session id = a26b1f181f7c4eed8c88556fb8331580-00000000000000000000000000000000
I20260807 19:49:02.204989 23282 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 19:49:02.208410 24035 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 19:49:02.216518 24035 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: tablet copy: Starting download of 0 data blocks...
I20260807 19:49:02.216992 24035 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: tablet copy: Starting download of 1 WAL segments...
I20260807 19:49:02.220917 24035 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 19:49:02.226353 23282 tablet_copy_service.cc:342] P 25e97a7361944c7394809e39705da6d6: Request end of tablet copy session a26b1f181f7c4eed8c88556fb8331580-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.155.189@KRBTEST.COM'} at 127.0.0.1:42908
I20260807 19:49:02.226637 23282 tablet_copy_service.cc:433] P 25e97a7361944c7394809e39705da6d6: ending tablet copy session a26b1f181f7c4eed8c88556fb8331580-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer a26b1f181f7c4eed8c88556fb8331580
I20260807 19:49:02.243602 24035 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:02.247570 24218 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:02.251698 24219 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:02.264804 24221 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:02.270828 24035 server_base.cc:1034] running on GCE node
I20260807 19:49:02.271325 24035 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:02.272159 24035 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:02.273415 24035 hybrid_clock.cc:648] HybridClock initialized: now 1786132142273336 us; error 49 us; skew 500 ppm
I20260807 19:49:02.273702 24035 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132142, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:02.276084 24035 init.cc:377] Logged in from keytab as oryx/127.12.155.189@KRBTEST.COM (short username oryx)
I20260807 19:49:02.277781 24035 webserver.cc:460] Webserver started at http://127.12.155.189:45069/ using document root <none> and password file <none>
I20260807 19:49:02.278223 24035 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:02.278334 24035 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:02.281024 24035 fs_manager.cc:709] Time spent opening directory manager: real 0.002s user 0.000s sys 0.002s
I20260807 19:49:02.283427 24231 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:02.283901 24035 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.000s
I20260807 19:49:02.284051 24035 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
uuid: "a26b1f181f7c4eed8c88556fb8331580"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "a0319cb324c09f99605d5459d954ceb9"
server_key_iv: "da8c54dd334db122fa0dd35026bc01bd"
server_key_version: "encryptionkey@0"
I20260807 19:49:02.284247 24035 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:02.287850 24024 heartbeater.cc:503] Master 127.12.155.190:44549 was elected leader, sending a full tablet report...
I20260807 19:49:02.302218 24035 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:02.306435 24035 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:02.330643 24035 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.189:35731
I20260807 19:49:02.331723 24035 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
I20260807 19:49:02.330667 24315 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.189:35731 every 8 connection(s)
I20260807 19:49:02.339912 24316 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:49:02.345220 24316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Bootstrap starting.
I20260807 19:49:02.361435 24316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Bootstrap replayed 1/1 log segments. Stats: ops{read=5 overwritten=0 applied=5 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:49:02.362139 24316 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: Bootstrap complete.
I20260807 19:49:02.363348 24316 raft_consensus.cc:348] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } }
I20260807 19:49:02.364019 24316 raft_consensus.cc:729] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: a26b1f181f7c4eed8c88556fb8331580, State: Initialized, Role: LEARNER
I20260807 19:49:02.364341 24316 consensus_queue.cc:260] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 5, Last appended: 1.5, Last appended by leader: 5, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } }
I20260807 19:49:02.365439 24321 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } } }
I20260807 19:49:02.365870 24316 sys_catalog.cc:564] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:02.365880 24321 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: LEARNER
I20260807 19:49:02.375766 24338 catalog_manager.cc:1259] Loaded cluster ID: 1ca527124c05406588dac8e36701c2f9
I20260807 19:49:02.375921 24338 catalog_manager.cc:1552] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: loading cluster ID for follower catalog manager: success
I20260807 19:49:02.378958 24338 catalog_manager.cc:1574] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: acquiring CA information for follower catalog manager: success
I20260807 19:49:02.381304 24338 catalog_manager.cc:1602] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:49:02.571463 24193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.560955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:60446)
0807 19:49:02.561369 (+ 414us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.561394 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.561572 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.563208 (+ 1636us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.563214 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.563262 (+ 48us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:02.563490 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.563503 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.566730 (+ 3227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.566736 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.568575 (+ 1839us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.568596 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.570418 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.570425 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.570677 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.570774 (+ 97us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.570905 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.571087 (+ 182us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":219}
I20260807 19:49:02.571507 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.561154 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60446 (local address 127.12.155.189:35731)
0807 19:49:02.562672 (+ 1518us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.562681 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.562707 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:49:02.562820 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.562829 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.562953 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.563112 (+ 159us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:02.563677 (+ 565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.566500 (+ 2823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.568779 (+ 2279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.570170 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.570417 (+ 247us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.570667 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.570937 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.571108 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1334,"thread_start_us":1123,"threads_started":1}
I20260807 19:49:02.573906 24275 raft_consensus.cc:1203] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.5] Dedup: 1.5->[]
I20260807 19:49:02.575079 24321 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e97a7361944c7394809e39705da6d6. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } } }
I20260807 19:49:02.575464 24321 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: LEARNER
W20260807 19:49:02.723697 24217 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:02.724192 24217 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:02.724416 24217 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:02.733564 24217 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:02.733741 24217 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:02.733850 24217 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:02.733956 24217 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:02.734012 24217 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:02.746850 24217 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.188.keytab
--principal=oryx/127.12.155.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:38351
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.155.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:02.748857 24217 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:02.750811 24217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:02.766009 24348 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:02.766134 24345 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:02.766438 24352 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:02.772756 24217 server_base.cc:1034] running on GCE node
I20260807 19:49:02.773977 24217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:02.776281 24217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:02.777565 24217 hybrid_clock.cc:648] HybridClock initialized: now 1786132142777450 us; error 83 us; skew 500 ppm
I20260807 19:49:02.778049 24217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132142, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:02.783286 24217 init.cc:377] Logged in from keytab as oryx/127.12.155.188@KRBTEST.COM (short username oryx)
I20260807 19:49:02.785624 24217 webserver.cc:460] Webserver started at http://127.12.155.188:43223/ using document root <none> and password file <none>
I20260807 19:49:02.786677 24217 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:02.786805 24217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:02.787153 24217 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:02.791520 24217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/instance:
uuid: "54c1596155894af490c826081bf8562f"
format_stamp: "Formatted at 2026-08-07 19:49:02 on dist-test-slave-2p8l"
server_key: "1a67d3a036a9004566bcba88a6ae323c"
server_key_iv: "2465d0f3ded8f8119dd6a71e1e7b44c6"
server_key_version: "encryptionkey@0"
I20260807 19:49:02.792465 24217 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal/instance:
uuid: "54c1596155894af490c826081bf8562f"
format_stamp: "Formatted at 2026-08-07 19:49:02 on dist-test-slave-2p8l"
server_key: "1a67d3a036a9004566bcba88a6ae323c"
server_key_iv: "2465d0f3ded8f8119dd6a71e1e7b44c6"
server_key_version: "encryptionkey@0"
I20260807 19:49:02.800050 24217 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 19:49:02.805049 24361 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:02.807034 24217 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:49:02.807354 24217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
uuid: "54c1596155894af490c826081bf8562f"
format_stamp: "Formatted at 2026-08-07 19:49:02 on dist-test-slave-2p8l"
server_key: "1a67d3a036a9004566bcba88a6ae323c"
server_key_iv: "2465d0f3ded8f8119dd6a71e1e7b44c6"
server_key_version: "encryptionkey@0"
I20260807 19:49:02.807716 24217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:02.833695 24217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:02.841432 24217 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:02.841843 24217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:02.873217 24217 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.188:38351
I20260807 19:49:02.873373 24434 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.188:38351 every 8 connection(s)
I20260807 19:49:02.875219 24217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
I20260807 19:49:02.877914 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 24217
I20260807 19:49:02.881450 24435 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:02.893352 24435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.188@KRBTEST.COM
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132142, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.188@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:02.910437 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.880862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59334 (local address 127.12.155.188:38351)
0807 19:49:02.882406 (+ 1544us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.882427 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.882491 (+ 64us) server_negotiation.cc:407] Connection header received
0807 19:49:02.884730 (+ 2239us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.884763 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.885212 (+ 449us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.885782 (+ 570us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.888403 (+ 2621us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.890199 (+ 1796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.892357 (+ 2158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.893177 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.893330 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.899978 (+ 6648us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.899992 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.900011 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.900063 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.904465 (+ 4402us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.905400 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.905415 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.905424 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.905636 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.906141 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.906147 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.906151 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.906913 (+ 762us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.907293 (+ 380us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.908024 (+ 731us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.908586 (+ 562us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1275,"thread_start_us":975,"threads_started":1}
I20260807 19:49:02.918742 24442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.897985 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42924 (local address 127.12.155.190:44549)
0807 19:49:02.899129 (+ 1144us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.899140 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.900843 (+ 1703us) server_negotiation.cc:407] Connection header received
0807 19:49:02.901243 (+ 400us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.901250 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.901348 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.901594 (+ 246us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.903140 (+ 1546us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.903996 (+ 856us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.905552 (+ 1556us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.906026 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.906227 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.911006 (+ 4779us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.911012 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.911016 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.911070 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.915175 (+ 4105us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.916166 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.916173 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.916177 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.916357 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.916796 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.916800 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.916803 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.917137 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.917344 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.917918 (+ 574us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.918247 (+ 329us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":936,"thread_start_us":652,"threads_started":1}
I20260807 19:49:02.918794 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.898043 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:42924)
0807 19:49:02.900577 (+ 2534us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.900632 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.901054 (+ 422us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.901639 (+ 585us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.901647 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.902617 (+ 970us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.902966 (+ 349us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.902976 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.904155 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.904161 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.905396 (+ 1235us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.905410 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.906273 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.906280 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.906475 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.907300 (+ 825us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.907330 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.910723 (+ 3393us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.915427 (+ 4704us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.915440 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.915449 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.916016 (+ 567us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.916484 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.916491 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.916495 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.916654 (+ 159us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.917313 (+ 659us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.917322 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.917547 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.917784 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.918238 (+ 454us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2076,"thread_start_us":1638,"threads_started":1}
I20260807 19:49:02.920871 24435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132142, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.188@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
I20260807 19:49:02.938534 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.921970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60454 (local address 127.12.155.189:35731)
0807 19:49:02.922256 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.922265 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.922373 (+ 108us) server_negotiation.cc:407] Connection header received
0807 19:49:02.922592 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.922598 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.922677 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.922875 (+ 198us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.924032 (+ 1157us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.924953 (+ 921us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.926859 (+ 1906us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.927394 (+ 535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.927560 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.931838 (+ 4278us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.931845 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.931849 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.931897 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.935097 (+ 3200us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.936098 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.936103 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.936106 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.936276 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.936741 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.936745 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.936747 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.937123 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.937314 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.937753 (+ 439us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.938095 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:49:02.938527 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.921857 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:60454)
0807 19:49:02.922266 (+ 409us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.922295 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.922433 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.922887 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.922892 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.923606 (+ 714us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.923846 (+ 240us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.923856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.925118 (+ 1262us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.925125 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.926692 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.926706 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.927578 (+ 872us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.927586 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.927797 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.928499 (+ 702us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.928521 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.931554 (+ 3033us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.935285 (+ 3731us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.935291 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.935297 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.935922 (+ 625us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.936413 (+ 491us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.936419 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.936424 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.936598 (+ 174us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.937273 (+ 675us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.937279 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.937466 (+ 187us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.937626 (+ 160us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.938045 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 19:49:02.940258 24435 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:49:02 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132142, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.188@KRBTEST.COM for oryx/127.12.155.188@KRBTEST.COM
I20260807 19:49:02.956086 24443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.941208 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.0.0.1:59336)
0807 19:49:02.941478 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:02.941499 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:02.941642 (+ 143us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:02.941983 (+ 341us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:02.941988 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:02.942443 (+ 455us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:02.942617 (+ 174us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.942625 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.943675 (+ 1050us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.943683 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.944593 (+ 910us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:02.944604 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.945322 (+ 718us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.945328 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:02.945526 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.946227 (+ 701us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:02.946247 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:02.948562 (+ 2315us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:02.952656 (+ 4094us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.952662 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.952667 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.953324 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.953824 (+ 500us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:02.953833 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:02.953839 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:02.954037 (+ 198us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:02.954768 (+ 731us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:02.954774 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:02.954986 (+ 212us) client_negotiation.cc:769] Sending connection context
0807 19:49:02.955161 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 19:49:02.955527 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":103}
I20260807 19:49:02.956146 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:02.941212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59336 (local address 127.12.155.188:38351)
0807 19:49:02.941470 (+ 258us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:02.941476 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:02.941573 (+ 97us) server_negotiation.cc:407] Connection header received
0807 19:49:02.941759 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:02.941780 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:02.941855 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:02.941970 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:02.942748 (+ 778us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.943560 (+ 812us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.944725 (+ 1165us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:02.945154 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:02.945282 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:02.948757 (+ 3475us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:02.948765 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:02.948771 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:02.948806 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:02.952415 (+ 3609us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.953495 (+ 1080us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.953502 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.953506 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.953680 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:02.954199 (+ 519us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:02.954207 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:02.954210 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:02.954635 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:02.954814 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:02.955282 (+ 468us) server_negotiation.cc:299] Negotiation successful
0807 19:49:02.955726 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":159,"server-negotiator.queue_time_us":103}
I20260807 19:49:02.962610 24435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Bootstrap starting.
I20260807 19:49:02.967700 24435 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:02.969861 24435 log.cc:824] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:02.973869 24435 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: No bootstrap required, opened a new log
I20260807 19:49:02.974917 24198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 5 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: NON_VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: true } } }
I20260807 19:49:02.975297 24198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:02.977845 24448 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: attempting to promote NON_VOTER a26b1f181f7c4eed8c88556fb8331580 to VOTER
I20260807 19:49:02.978868 24448 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 1.5, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } }
I20260807 19:49:02.980930 24275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 LEARNER]: Refusing update from remote peer 25e97a7361944c7394809e39705da6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 5. Preceding OpId from leader: term: 1 index: 6. (index mismatch)
I20260807 19:49:02.981534 24198 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20260807 19:49:02.984445 24435 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } }
I20260807 19:49:02.984871 24435 raft_consensus.cc:374] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:02.984997 24435 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 54c1596155894af490c826081bf8562f, State: Initialized, Role: FOLLOWER
I20260807 19:49:02.985872 24435 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } }
I20260807 19:49:02.986012 24448 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 LEADER]: Committing config change with OpId 1.6: config changed from index 5 to 6, a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } }
I20260807 19:49:02.986940 24275 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Committing config change with OpId 1.6: config changed from index 5 to 6, a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189) changed from NON_VOTER to VOTER. New config: { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } }
I20260807 19:49:02.990801 24321 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } }
I20260807 19:49:02.991135 24321 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:02.991758 24198 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } }
I20260807 19:49:02.992071 24198 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:02.992036 24450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 6 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } }
I20260807 19:49:02.992419 24450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:02.991514 24455 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } } }
I20260807 19:49:02.992738 24455 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:02.993738 24435 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: configured and running, proceeding with master startup.
W20260807 19:49:03.005802 24478 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:49:03.006119 24478 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:49:03.011197 24217 master_runner.cc:428] Detected that this master 54c1596155894af490c826081bf8562f is joining an existing cluster
I20260807 19:49:03.011332 24217 master_runner.cc:432] Initiating AddMaster RPC to add 127.12.155.188:38351
I20260807 19:49:03.017946 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 23355
I20260807 19:49:03.043916 24339 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.019769 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60466 (local address 127.12.155.189:35731)
0807 19:49:03.020002 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.020010 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.021168 (+ 1158us) server_negotiation.cc:407] Connection header received
0807 19:49:03.021538 (+ 370us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.021549 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.021699 (+ 150us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.021810 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.024265 (+ 2455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.025927 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.028601 (+ 2674us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.029874 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.030028 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.034188 (+ 4160us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.034200 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.034208 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.034269 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.039118 (+ 4849us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.040284 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.040294 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.040300 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.040505 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.041099 (+ 594us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.041107 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.041114 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.041598 (+ 484us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.041774 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.042864 (+ 1090us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.043333 (+ 469us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.129@KRBTEST.COM
I20260807 19:49:03.055184 24490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.018969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:60466)
0807 19:49:03.020945 (+ 1976us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.020966 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.021314 (+ 348us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.022246 (+ 932us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.022254 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.023413 (+ 1159us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.024023 (+ 610us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.024041 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.026278 (+ 2237us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.026286 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.028381 (+ 2095us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.028400 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.030630 (+ 2230us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.030642 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.030997 (+ 355us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.031961 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.031997 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.033860 (+ 1863us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.039323 (+ 5463us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.039332 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.039339 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.040119 (+ 780us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.040683 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.040690 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.040697 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.040955 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.041907 (+ 952us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.041915 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.042386 (+ 471us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.044748 (+ 2362us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.045626 (+ 878us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1795,"thread_start_us":25540,"threads_started":1}
I20260807 19:49:03.063849 24488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.019563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50184 (local address 127.12.155.129:45995)
0807 19:49:03.034728 (+ 15165us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.034741 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.034823 (+ 82us) server_negotiation.cc:407] Connection header received
0807 19:49:03.034934 (+ 111us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.034947 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.035418 (+ 471us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.038448 (+ 3030us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.038793 (+ 345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.040861 (+ 2068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.043055 (+ 2194us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.044561 (+ 1506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.052940 (+ 8379us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.053328 (+ 388us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.053348 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.053376 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.053424 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.059073 (+ 5649us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.060301 (+ 1228us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.060313 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.060316 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.060504 (+ 188us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.061035 (+ 531us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.061039 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.061042 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.061570 (+ 528us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.061971 (+ 401us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.062731 (+ 760us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.063324 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14897,"thread_start_us":16134,"threads_started":1}
I20260807 19:49:03.066228 23557 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:03.079478 24491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.027322 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.0.0.1:59338)
0807 19:49:03.055190 (+ 27868us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.055217 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.055453 (+ 236us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.055982 (+ 529us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.055987 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.056817 (+ 830us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.057229 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.057255 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.061550 (+ 4295us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.061556 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.063173 (+ 1617us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.063190 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.064955 (+ 1765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.064963 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.065138 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.065934 (+ 796us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.065961 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.067630 (+ 1669us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.074788 (+ 7158us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.074794 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.074798 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.075644 (+ 846us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.076245 (+ 601us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.076252 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.076258 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.076519 (+ 261us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.077553 (+ 1034us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.077558 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.077807 (+ 249us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.078004 (+ 197us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.078423 (+ 419us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":27280,"thread_start_us":26884,"threads_started":1}
I20260807 19:49:03.080775 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.027966 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59338 (local address 127.12.155.188:38351)
0807 19:49:03.028260 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.028269 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.055323 (+ 27054us) server_negotiation.cc:407] Connection header received
0807 19:49:03.055609 (+ 286us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.055616 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.055711 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.055816 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.060128 (+ 4312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.061325 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.063336 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.064114 (+ 778us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.064217 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.067848 (+ 3631us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.067857 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.067865 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.067909 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.074636 (+ 6727us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.075802 (+ 1166us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.075808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.075832 (+ 24us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.076060 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.076688 (+ 628us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.076694 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.076698 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.077251 (+ 553us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.077492 (+ 241us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.080001 (+ 2509us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.080279 (+ 278us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 19:49:03.084285 24442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.020663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42930 (local address 127.12.155.190:44549)
0807 19:49:03.020893 (+ 230us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.020900 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.044194 (+ 23294us) server_negotiation.cc:407] Connection header received
0807 19:49:03.046180 (+ 1986us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.046188 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.046332 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.046443 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.050188 (+ 3745us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.051726 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.063375 (+ 11649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.064644 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.064839 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.074824 (+ 9985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.074835 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.074841 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.074939 (+ 98us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.080061 (+ 5122us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.081095 (+ 1034us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.081102 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.081106 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.081302 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.082004 (+ 702us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.082011 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.082013 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.082529 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.082856 (+ 327us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.083698 (+ 842us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.083956 (+ 258us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 19:49:03.085635 24486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.020108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:42930)
0807 19:49:03.043981 (+ 23873us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.044009 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.045639 (+ 1630us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.046773 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.046776 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.047789 (+ 1013us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.048198 (+ 409us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.048216 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.052042 (+ 3826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.052050 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.062375 (+ 10325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.062390 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.071648 (+ 9258us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.071661 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.071944 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.072694 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.072733 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.074465 (+ 1732us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.080273 (+ 5808us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.080278 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.080282 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.080915 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.081487 (+ 572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.081495 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.081502 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.081796 (+ 294us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.082968 (+ 1172us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.082973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.083352 (+ 379us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.084636 (+ 1284us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.085005 (+ 369us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":23655,"thread_start_us":803,"threads_started":1}
W20260807 19:49:03.095613 24371 tablet.cc:2369] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Can't schedule compaction. Clean time has not been advanced past its initial value.
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132139, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.190@KRBTEST.COM for oryx/127.12.155.188@KRBTEST.COM
I20260807 19:49:03.118337 24441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.092772 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59346 (local address 127.12.155.188:38351)
0807 19:49:03.093056 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.093066 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.101200 (+ 8134us) server_negotiation.cc:407] Connection header received
0807 19:49:03.101552 (+ 352us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.101557 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.101673 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.101801 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.103287 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.104322 (+ 1035us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.105952 (+ 1630us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.106687 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.106852 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.110798 (+ 3946us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.110804 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.110808 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.110849 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.115068 (+ 4219us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.115925 (+ 857us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.115938 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.115941 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.116092 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.116534 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.116538 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.116541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.116897 (+ 356us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.117082 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.117575 (+ 493us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.117843 (+ 268us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":98}
I20260807 19:49:03.118356 24494 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.092789 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.0.0.1:59346)
0807 19:49:03.101041 (+ 8252us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.101065 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.101290 (+ 225us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.101842 (+ 552us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.101852 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.102737 (+ 885us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.103103 (+ 366us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.103115 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.104490 (+ 1375us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.104496 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.105703 (+ 1207us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.105728 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.106874 (+ 1146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.106881 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.107081 (+ 200us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.107842 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.107865 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.110556 (+ 2691us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.115240 (+ 4684us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.115249 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.115256 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.115776 (+ 520us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.116222 (+ 446us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.116228 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.116235 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.116399 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.117034 (+ 635us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.117040 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.117222 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.117397 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.117781 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8093,"thread_start_us":7908,"threads_started":1}
I20260807 19:49:03.120858 23251 catalog_manager.cc:6979] Initiating ChangeConfig request to add master 127.12.155.188:38351: tablet_id: "00000000000000000000000000000000"
type: ADD_PEER
server {
permanent_uuid: "54c1596155894af490c826081bf8562f"
member_type: NON_VOTER
last_known_addr {
host: "127.12.155.188"
port: 38351
}
attrs {
promote: true
}
}
dest_uuid: "25e97a7361944c7394809e39705da6d6"
cas_config_opid_index: 6
I20260807 19:49:03.121896 23251 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 1.6, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } }
I20260807 19:49:03.125102 24275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Refusing update from remote peer 25e97a7361944c7394809e39705da6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 6. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 19:49:03.126119 24400 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:03.127331 24458 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20260807 19:49:03.131397 24448 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 LEADER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 54c1596155894af490c826081bf8562f (127.12.155.188) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.132267 24275 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Committing config change with OpId 1.7: config changed from index 6 to 7, NON_VOTER 54c1596155894af490c826081bf8562f (127.12.155.188) added. New config: { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.137014 24448 catalog_manager.cc:6983] Successfully completed master ChangeConfig request to add master 127.12.155.188:38351
I20260807 19:49:03.137485 24450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.137880 24450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:03.138151 24217 master.cc:537] Master@127.12.155.188:38351 shutting down...
I20260807 19:49:03.138307 24450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.138556 24450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:03.140376 24400 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Refusing update from remote peer 25e97a7361944c7394809e39705da6d6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 7. (index mismatch)
I20260807 19:49:03.140177 24321 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.140573 24321 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:03.143735 24450 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:49:03.151130 23230 consensus_peers.cc:487] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 -> Peer 54c1596155894af490c826081bf8562f (127.12.155.188:38351): Couldn't send request to peer 54c1596155894af490c826081bf8562f. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on Master. This is attempt 1: this message will repeat every 5th retry.
I20260807 19:49:03.182401 24217 raft_consensus.cc:2229] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:03.183485 24217 raft_consensus.cc:2258] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:03.184046 24217 tablet_replica.cc:330] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: stopping tablet replica
I20260807 19:49:03.194862 24217 master.cc:552] Master@127.12.155.188:38351 shutdown complete.
I20260807 19:49:03.195063 24217 master_runner.cc:305] Clearing existing system tablet
I20260807 19:49:03.195616 24217 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:03.195860 24217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:03.199687 24217 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:49:03.202041 24499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:03.202534 24217 fs_report.cc:383] FS layout report
--------------------
wal directory:
metadata directory:
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:03.202834 24217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20260807 19:49:03.202950 24217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
uuid: "54c1596155894af490c826081bf8562f"
format_stamp: "Formatted at 2026-08-07 19:49:02 on dist-test-slave-2p8l"
server_key: "1a67d3a036a9004566bcba88a6ae323c"
server_key_iv: "2465d0f3ded8f8119dd6a71e1e7b44c6"
server_key_version: "encryptionkey@0"
I20260807 19:49:03.209092 24217 ts_tablet_manager.cc:1905] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:03.217121 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 23355
I20260807 19:49:03.223875 24217 ts_tablet_manager.cc:1918] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId unknown
I20260807 19:49:03.224129 24217 log.cc:1196] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal/wals/00000000000000000000000000000000
I20260807 19:49:03.224714 24217 ts_tablet_manager.cc:1939] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Deleting consensus metadata
I20260807 19:49:03.225003 24217 master_runner.cc:315] Copying system tablet from 127.12.155.190:44549
I20260807 19:49:03.236833 24217 tablet_copy_client.cc:316] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: tablet copy: Beginning tablet copy session from remote peer at address 127.12.155.190:44549
I20260807 19:49:03.258492 24442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.238255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42934 (local address 127.12.155.190:44549)
0807 19:49:03.238595 (+ 340us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.238602 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.239033 (+ 431us) server_negotiation.cc:407] Connection header received
0807 19:49:03.239436 (+ 403us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.239446 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.239564 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.239662 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.241412 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.242927 (+ 1515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.245395 (+ 2468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.246392 (+ 997us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.246583 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.249390 (+ 2807us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.249400 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.249409 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.249467 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.254332 (+ 4865us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.255400 (+ 1068us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.255407 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.255411 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.255593 (+ 182us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.256182 (+ 589us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.256188 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.256191 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.256647 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.256817 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.257605 (+ 788us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.258034 (+ 429us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":123}
I20260807 19:49:03.258658 24507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.238108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:42934)
0807 19:49:03.238867 (+ 759us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.238902 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.239209 (+ 307us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.239968 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.239976 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.240810 (+ 834us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.241184 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.241201 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.243416 (+ 2215us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.243422 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.245210 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.245228 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.246576 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.246583 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.246788 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.247752 (+ 964us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.247779 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.249134 (+ 1355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.254543 (+ 5409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.254553 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.254561 (+ 8us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.255242 (+ 681us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.255763 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.255771 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.255778 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.256036 (+ 258us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.256964 (+ 928us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.256973 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.257242 (+ 269us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.257441 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.257927 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":551,"thread_start_us":386,"threads_started":1}
I20260807 19:49:03.259778 23282 tablet_copy_service.cc:140] P 25e97a7361944c7394809e39705da6d6: Received BeginTabletCopySession request for tablet 00000000000000000000000000000000 from peer 54c1596155894af490c826081bf8562f ({username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:42934)
I20260807 19:49:03.260006 23282 tablet_copy_service.cc:161] P 25e97a7361944c7394809e39705da6d6: Beginning new tablet copy session on tablet 00000000000000000000000000000000 from peer 54c1596155894af490c826081bf8562f at {username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:42934: session id = 54c1596155894af490c826081bf8562f-00000000000000000000000000000000
I20260807 19:49:03.263489 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:45995
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:44549
--webserver_port=33733
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:03.264139 23282 tablet_copy_source_session.cc:205] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Tablet Copy: opened 0 blocks and 1 log segments
I20260807 19:49:03.267066 24217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total
I20260807 19:49:03.276829 24217 tablet_copy_client.cc:791] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: tablet copy: Starting download of 0 data blocks...
I20260807 19:49:03.277236 24217 tablet_copy_client.cc:655] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: tablet copy: Starting download of 1 WAL segments...
I20260807 19:49:03.280866 24217 tablet_copy_client.cc:531] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20260807 19:49:03.287698 23282 tablet_copy_service.cc:342] P 25e97a7361944c7394809e39705da6d6: Request end of tablet copy session 54c1596155894af490c826081bf8562f-00000000000000000000000000000000 received from {username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:42934
I20260807 19:49:03.287932 23282 tablet_copy_service.cc:433] P 25e97a7361944c7394809e39705da6d6: ending tablet copy session 54c1596155894af490c826081bf8562f-00000000000000000000000000000000 on tablet 00000000000000000000000000000000 with peer 54c1596155894af490c826081bf8562f
I20260807 19:49:03.306721 24217 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:03.310227 24511 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:03.323402 24512 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:03.326442 24514 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:03.328841 24217 server_base.cc:1034] running on GCE node
I20260807 19:49:03.329391 24217 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:03.353729 24217 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:03.355037 24217 hybrid_clock.cc:648] HybridClock initialized: now 1786132143354913 us; error 167 us; skew 500 ppm
I20260807 19:49:03.355402 24217 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132143, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:03.358685 24217 init.cc:377] Logged in from keytab as oryx/127.12.155.188@KRBTEST.COM (short username oryx)
I20260807 19:49:03.363065 24217 webserver.cc:460] Webserver started at http://127.12.155.188:34621/ using document root <none> and password file <none>
I20260807 19:49:03.363524 24217 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:03.363663 24217 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:03.367664 24217 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:49:03.370164 24524 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:03.370643 24217 fs_manager.cc:725] Time spent opening block manager: real 0.002s user 0.001s sys 0.001s
I20260807 19:49:03.370847 24217 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
uuid: "54c1596155894af490c826081bf8562f"
format_stamp: "Formatted at 2026-08-07 19:49:02 on dist-test-slave-2p8l"
server_key: "1a67d3a036a9004566bcba88a6ae323c"
server_key_iv: "2465d0f3ded8f8119dd6a71e1e7b44c6"
server_key_version: "encryptionkey@0"
I20260807 19:49:03.371155 24217 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:03.397360 24217 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:03.402535 24217 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:03.446709 24217 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.188:38351
I20260807 19:49:03.446728 24594 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.188:38351 every 8 connection(s)
I20260807 19:49:03.448133 24217 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
I20260807 19:49:03.454620 24597 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:49:03.459124 24597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Bootstrap starting.
I20260807 19:49:03.482636 24597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Bootstrap replayed 1/1 log segments. Stats: ops{read=7 overwritten=0 applied=7 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:49:03.483403 24597 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Bootstrap complete.
I20260807 19:49:03.484903 24597 raft_consensus.cc:348] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } }
I20260807 19:49:03.485265 24597 raft_consensus.cc:729] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 54c1596155894af490c826081bf8562f, State: Initialized, Role: LEARNER
I20260807 19:49:03.485558 24597 consensus_queue.cc:260] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 7, Last appended: 1.7, Last appended by leader: 7, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } }
I20260807 19:49:03.486625 24602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.487016 24597 sys_catalog.cc:564] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:03.487205 24602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: This master's current role is: LEARNER
I20260807 19:49:03.506179 24619 catalog_manager.cc:1259] Loaded cluster ID: 1ca527124c05406588dac8e36701c2f9
I20260807 19:49:03.506327 24619 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: loading cluster ID for follower catalog manager: success
I20260807 19:49:03.510455 24619 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: acquiring CA information for follower catalog manager: success
I20260807 19:49:03.513459 24619 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:49:03.727085 24620 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.715350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.0.0.1:59356)
0807 19:49:03.719479 (+ 4129us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.719505 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.719686 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.720193 (+ 507us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.720197 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.720223 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:03.720449 (+ 226us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.720459 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.722562 (+ 2103us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.722571 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.724292 (+ 1721us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.724312 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.726381 (+ 2069us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.726386 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.726540 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.726571 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.726654 (+ 83us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.726778 (+ 124us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4000,"thread_start_us":3885,"threads_started":1}
I20260807 19:49:03.727416 24621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.715589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59356 (local address 127.12.155.188:38351)
0807 19:49:03.719299 (+ 3710us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.719311 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.719631 (+ 320us) server_negotiation.cc:407] Connection header received
0807 19:49:03.719850 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.719858 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.719990 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.720178 (+ 188us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:03.720613 (+ 435us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.722381 (+ 1768us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.724529 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.726121 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.726417 (+ 296us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.726720 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.726785 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.726954 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3501,"thread_start_us":3305,"threads_started":1}
I20260807 19:49:03.728745 24568 raft_consensus.cc:1203] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 LEARNER]: Deduplicated request from leader. Original: 0.0->[1.1-1.7] Dedup: 1.7->[]
I20260807 19:49:03.729549 24602 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 25e97a7361944c7394809e39705da6d6. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:03.730090 24602 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: This master's current role is: LEARNER
W20260807 19:49:03.781589 24509 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:03.782174 24509 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:03.782311 24509 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:03.790827 24509 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:03.790977 24509 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:03.791216 24509 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:03.803454 24509 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:45995
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=33733
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:03.805306 24509 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:03.807248 24509 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:03.826035 24634 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:03.826261 24636 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:03.826097 24629 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:03.827805 24509 server_base.cc:1034] running on GCE node
I20260807 19:49:03.828583 24509 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:03.829911 24509 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:03.831198 24509 hybrid_clock.cc:648] HybridClock initialized: now 1786132143831045 us; error 115 us; skew 500 ppm
I20260807 19:49:03.831879 24509 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132143, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:03.836306 24509 init.cc:377] Logged in from keytab as oryx/127.12.155.129@KRBTEST.COM (short username oryx)
I20260807 19:49:03.838601 24509 webserver.cc:460] Webserver started at http://127.12.155.129:33733/ using document root <none> and password file <none>
I20260807 19:49:03.839620 24509 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:03.839831 24509 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:03.847323 24509 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:49:03.851145 24649 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:03.852936 24509 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:03.853156 24509 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "0a968bf47dde475794cf3d231c9ecb58"
format_stamp: "Formatted at 2026-08-07 19:48:59 on dist-test-slave-2p8l"
server_key: "0ff62b23fb247686f63ec7f124c50a20"
server_key_iv: "6c6f27fce6fb21ca163eeb59941494b9"
server_key_version: "encryptionkey@0"
I20260807 19:49:03.854449 24509 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:03.880352 24509 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:03.885792 24509 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:03.886197 24509 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:03.887620 24509 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:03.889540 24509 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:03.889676 24509 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:03.889807 24509 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:03.889927 24509 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:03.942981 24509 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:45995
I20260807 19:49:03.943156 24843 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:45995 every 8 connection(s)
I20260807 19:49:03.945211 24509 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:03.951403 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 24509
I20260807 19:49:03.951961 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 23573
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132143, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132143, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132143, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.188@KRBTEST.COM
Aug 07 19:49:03 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.130@KRBTEST.COM
I20260807 19:49:03.996338 24850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.948902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:58309 (local address 127.12.155.189:35731)
0807 19:49:03.969078 (+ 20176us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.969089 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.969134 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:49:03.969229 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.969719 (+ 490us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.969859 (+ 140us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.970006 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.972918 (+ 2912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.974246 (+ 1328us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.977365 (+ 3119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.978150 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.978259 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.986405 (+ 8146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.986413 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.986418 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.986470 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.991216 (+ 4746us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.992699 (+ 1483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.992707 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.992710 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.992889 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.993782 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.993788 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.993791 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.994257 (+ 466us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.994415 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.995587 (+ 1172us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.995893 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19963,"thread_start_us":20664,"threads_started":1}
I20260807 19:49:03.996925 24621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.950368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51109 (local address 127.12.155.188:38351)
0807 19:49:03.950600 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.950608 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.965952 (+ 15344us) server_negotiation.cc:407] Connection header received
0807 19:49:03.968718 (+ 2766us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.968724 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.968839 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.968916 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.974709 (+ 5793us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.975837 (+ 1128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.978037 (+ 2200us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.978719 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.978867 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.986609 (+ 7742us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.986618 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.986625 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.986691 (+ 66us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.991101 (+ 4410us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.992696 (+ 1595us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.992703 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.992707 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.992894 (+ 187us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.993749 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.993755 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.993759 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.994257 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.994434 (+ 177us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.996207 (+ 1773us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.996534 (+ 327us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:49:03.998153 24859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.954264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33322 (local address 127.12.155.130:36363)
0807 19:49:03.970866 (+ 16602us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.970877 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.970912 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:49:03.971003 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.971013 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.971324 (+ 311us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.971774 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.974378 (+ 2604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.976115 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.978134 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.979095 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.979228 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.987904 (+ 8676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.987934 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.987965 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.988029 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.993427 (+ 5398us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.994753 (+ 1326us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.994766 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.994769 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.994989 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.995532 (+ 543us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.995537 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.995540 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.996059 (+ 519us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.996390 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.997372 (+ 982us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.997702 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16383,"thread_start_us":15945,"threads_started":1}
I20260807 19:49:03.998204 24861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.949878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:40523)
0807 19:49:03.964339 (+ 14461us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.964364 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.968080 (+ 3716us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.969730 (+ 1650us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.969751 (+ 21us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.972276 (+ 2525us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.972862 (+ 586us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.972877 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.974692 (+ 1815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.974697 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.977170 (+ 2473us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.977187 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.979175 (+ 1988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.979185 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.979401 (+ 216us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.980379 (+ 978us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.980402 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.985522 (+ 5120us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.992058 (+ 6536us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.992063 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.992067 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.992961 (+ 894us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.993608 (+ 647us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.993612 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.993615 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.993854 (+ 239us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.995496 (+ 1642us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.995503 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.995662 (+ 159us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.995837 (+ 175us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.997337 (+ 1500us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14244,"mutex_wait_us":1811,"thread_start_us":15686,"threads_started":1}
I20260807 19:49:03.998293 24854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.949877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.12.155.129:58309)
0807 19:49:03.960547 (+ 10670us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.960637 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.968080 (+ 7443us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.970267 (+ 2187us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.970274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.971355 (+ 1081us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.972650 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.972674 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.974520 (+ 1846us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.974530 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.977172 (+ 2642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.977187 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.978716 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.978724 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.979166 (+ 442us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.980305 (+ 1139us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.980350 (+ 45us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.986022 (+ 5672us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.991422 (+ 5400us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.991427 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.991446 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.992503 (+ 1057us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.993067 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.993072 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.993075 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.993396 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.994516 (+ 1120us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.994521 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.995094 (+ 573us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.995479 (+ 385us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.996188 (+ 709us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9279,"mutex_wait_us":167,"spinlock_wait_cycles":2432,"thread_start_us":11299,"threads_started":1}
I20260807 19:49:03.999212 24853 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.949273 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:40523 (local address 127.12.155.190:44549)
0807 19:49:03.965697 (+ 16424us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:03.965706 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:03.965744 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:49:03.968637 (+ 2893us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:03.968647 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:03.968772 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:03.968897 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:03.973087 (+ 4190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.974344 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.978104 (+ 3760us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.978867 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.979032 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.986096 (+ 7064us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:03.986113 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:03.986123 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:03.986194 (+ 71us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:03.991215 (+ 5021us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.993238 (+ 2023us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.993245 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.993248 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.993445 (+ 197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:03.994516 (+ 1071us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:03.994522 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:03.994525 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:03.994934 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:03.995113 (+ 179us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:03.997479 (+ 2366us) server_negotiation.cc:299] Negotiation successful
0807 19:49:03.997794 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16235,"thread_start_us":16493,"threads_started":1}
I20260807 19:49:03.999771 24856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:03.955007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.12.155.129:51109)
0807 19:49:03.965747 (+ 10740us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:03.965767 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:03.968532 (+ 2765us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:03.970085 (+ 1553us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:03.970093 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:03.971507 (+ 1414us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:03.974490 (+ 2983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.974506 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.976035 (+ 1529us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.976041 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.977875 (+ 1834us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:03.977889 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:03.979815 (+ 1926us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:03.979822 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:03.980019 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:03.980959 (+ 940us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:03.980983 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:03.986283 (+ 5300us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:03.991400 (+ 5117us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.991415 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.991445 (+ 30us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.992511 (+ 1066us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.993052 (+ 541us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:03.993057 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:03.993061 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:03.993602 (+ 541us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:03.994421 (+ 819us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:03.994432 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:03.995094 (+ 662us) client_negotiation.cc:769] Sending connection context
0807 19:49:03.998899 (+ 3805us) client_negotiation.cc:240] Negotiation successful
0807 19:49:03.999241 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10574,"mutex_wait_us":61,"spinlock_wait_cycles":80512,"thread_start_us":7228,"threads_started":1}
I20260807 19:49:04.000398 24847 heartbeater.cc:347] Connected to a master server at 127.12.155.189:35731
I20260807 19:49:04.000804 24847 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:04.000833 23770 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:04.001363 24846 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44549
I20260807 19:49:04.001574 24846 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:04.002197 24847 heartbeater.cc:511] Master 127.12.155.189:35731 requested a full tablet report, sending...
I20260807 19:49:04.002377 24846 heartbeater.cc:511] Master 127.12.155.190:44549 requested a full tablet report, sending...
I20260807 19:49:04.003129 24845 heartbeater.cc:347] Connected to a master server at 127.12.155.188:38351
I20260807 19:49:04.003326 24845 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:04.003820 24845 heartbeater.cc:511] Master 127.12.155.188:38351 requested a full tablet report, sending...
I20260807 19:49:04.004974 23251 ts_manager.cc:194] Re-registered known tserver with Master: 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995)
I20260807 19:49:04.005375 24263 ts_manager.cc:194] Registered new tserver with Master: 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995)
I20260807 19:49:04.006328 23251 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:40523
I20260807 19:49:04.006382 24554 ts_manager.cc:194] Registered new tserver with Master: 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995)
I20260807 19:49:04.099450 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 23573
I20260807 19:49:04.131871 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:36363
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:44549
--webserver_port=38577
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:04.290397 24450 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 7 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: NON_VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: true } } }
I20260807 19:49:04.290871 24450 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:04.292659 24867 raft_consensus.cc:1050] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: attempting to promote NON_VOTER 54c1596155894af490c826081bf8562f to VOTER
I20260807 19:49:04.293525 24867 consensus_queue.cc:237] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 7, Committed index: 7, Last appended: 1.7, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:04.297041 24275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Refusing update from remote peer 25e97a7361944c7394809e39705da6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 19:49:04.297422 24568 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 LEARNER]: Refusing update from remote peer 25e97a7361944c7394809e39705da6d6: Log matching property violated. Preceding OpId in replica: term: 1 index: 7. Preceding OpId from leader: term: 1 index: 8. (index mismatch)
I20260807 19:49:04.297997 24867 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 19:49:04.298642 24865 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 8, Last known committed idx: 7, Time since last communication: 0.000s
I20260807 19:49:04.308137 24867 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [term 1 LEADER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 54c1596155894af490c826081bf8562f (127.12.155.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.310014 24275 raft_consensus.cc:2932] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 54c1596155894af490c826081bf8562f (127.12.155.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.309846 24568 raft_consensus.cc:2932] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Committing config change with OpId 1.8: config changed from index 7 to 8, 54c1596155894af490c826081bf8562f (127.12.155.188) changed from NON_VOTER to VOTER. New config: { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.312806 24865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Config change replication complete. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.313138 24865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:04.313524 24865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.313804 24865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:04.314143 24865 sys_catalog.cc:455] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.314378 24865 sys_catalog.cc:458] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:04.316280 24876 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.316632 24876 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:04.317432 24875 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "25e97a7361944c7394809e39705da6d6" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:04.317915 24875 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: FOLLOWER
W20260807 19:49:04.562204 24864 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:04.562791 24864 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:04.562990 24864 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:04.571907 24864 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:04.572100 24864 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:04.572288 24864 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:04.584256 24864 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:36363
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=38577
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:04.586370 24864 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:04.588397 24864 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:04.605639 24887 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:04.605664 24892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:04.605592 24889 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:04.611981 24864 server_base.cc:1034] running on GCE node
I20260807 19:49:04.612946 24864 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:04.614423 24864 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:04.615737 24864 hybrid_clock.cc:648] HybridClock initialized: now 1786132144615674 us; error 71 us; skew 500 ppm
I20260807 19:49:04.616179 24864 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:04 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132144, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:04.620513 24864 init.cc:377] Logged in from keytab as oryx/127.12.155.130@KRBTEST.COM (short username oryx)
I20260807 19:49:04.622622 24864 webserver.cc:460] Webserver started at http://127.12.155.130:38577/ using document root <none> and password file <none>
I20260807 19:49:04.623636 24864 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:04.623874 24864 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:04.630949 24864 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260807 19:49:04.634577 24905 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:04.636456 24864 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:04.636695 24864 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "fc57c251e3044bd79497324d416183d5"
format_stamp: "Formatted at 2026-08-07 19:49:00 on dist-test-slave-2p8l"
server_key: "482884f418a89346a96f5e4269e6db49"
server_key_iv: "9ac576b2db407501e1bdb94d7a868711"
server_key_version: "encryptionkey@0"
I20260807 19:49:04.637913 24864 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:04.655340 24864 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:04.660838 24864 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:04.661198 24864 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:04.662599 24864 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:04.664345 24864 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:04.664484 24864 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:04.664623 24864 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:04.664721 24864 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:04.705351 24864 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:36363
I20260807 19:49:04.705425 25079 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:36363 every 8 connection(s)
I20260807 19:49:04.707666 24864 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:04.717957 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 24864
I20260807 19:49:04.718464 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 23793
Aug 07 19:49:04 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132138, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.131@KRBTEST.COM
Aug 07 19:49:04 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132144, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
Aug 07 19:49:04 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132144, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
Aug 07 19:49:04 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132144, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.188@KRBTEST.COM
I20260807 19:49:04.758594 25099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.720011 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45880 (local address 127.12.155.131:35151)
0807 19:49:04.727358 (+ 7347us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:04.727374 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:04.727441 (+ 67us) server_negotiation.cc:407] Connection header received
0807 19:49:04.727566 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:04.727581 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:04.728065 (+ 484us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:04.730268 (+ 2203us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:04.731198 (+ 930us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.733349 (+ 2151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.735412 (+ 2063us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.736378 (+ 966us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.743098 (+ 6720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.744838 (+ 1740us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:04.744857 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:04.744881 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:04.744932 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:04.752386 (+ 7454us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.753858 (+ 1472us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.753873 (+ 15us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.753878 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.754115 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.754676 (+ 561us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.754683 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.754686 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.755271 (+ 585us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:04.755671 (+ 400us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:04.757289 (+ 1618us) server_negotiation.cc:299] Negotiation successful
0807 19:49:04.757659 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7115,"thread_start_us":6907,"threads_started":1}
I20260807 19:49:04.760804 25091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.711373 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:58383 (local address 127.12.155.189:35731)
0807 19:49:04.727731 (+ 16358us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:04.727753 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:04.729886 (+ 2133us) server_negotiation.cc:407] Connection header received
0807 19:49:04.734783 (+ 4897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:04.734794 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:04.734930 (+ 136us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:04.735229 (+ 299us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:04.738832 (+ 3603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.740247 (+ 1415us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.743883 (+ 3636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.744654 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.744768 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.751145 (+ 6377us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:04.751158 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:04.751164 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:04.751226 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:04.755947 (+ 4721us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.757229 (+ 1282us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.757236 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.757243 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.757458 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.758222 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.758228 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.758233 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.758655 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:04.758813 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:04.760051 (+ 1238us) server_negotiation.cc:299] Negotiation successful
0807 19:49:04.760372 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16146,"thread_start_us":16378,"threads_started":1}
I20260807 19:49:04.760843 24016 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:04.761101 25090 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.711282 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:54943 (local address 127.12.155.190:44549)
0807 19:49:04.728400 (+ 17118us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:04.728410 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:04.732349 (+ 3939us) server_negotiation.cc:407] Connection header received
0807 19:49:04.734919 (+ 2570us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:04.734927 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:04.735048 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:04.735342 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:04.738841 (+ 3499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.740225 (+ 1384us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.743905 (+ 3680us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.744649 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.744762 (+ 113us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.752045 (+ 7283us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:04.752056 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:04.752064 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:04.752142 (+ 78us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:04.757160 (+ 5018us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.758364 (+ 1204us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.758439 (+ 75us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.758443 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.758619 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.759130 (+ 511us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.759135 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.759138 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.759600 (+ 462us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:04.759757 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:04.760371 (+ 614us) server_negotiation.cc:299] Negotiation successful
0807 19:49:04.760643 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16928,"thread_start_us":17199,"threads_started":1}
I20260807 19:49:04.762569 25093 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.712653 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:41987 (local address 127.12.155.188:38351)
0807 19:49:04.731917 (+ 19264us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:04.731926 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:04.733436 (+ 1510us) server_negotiation.cc:407] Connection header received
0807 19:49:04.734890 (+ 1454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:04.734896 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:04.735028 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:04.735311 (+ 283us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:04.738830 (+ 3519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.740406 (+ 1576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.743882 (+ 3476us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.744679 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.744775 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.752299 (+ 7524us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:04.752308 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:04.752312 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:04.752369 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:04.756948 (+ 4579us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.758031 (+ 1083us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.758036 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.758040 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.758352 (+ 312us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:04.759416 (+ 1064us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:04.759421 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:04.759424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:04.759818 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:04.760010 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:04.760784 (+ 774us) server_negotiation.cc:299] Negotiation successful
0807 19:49:04.761898 (+ 1114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":19117,"thread_start_us":18907,"threads_started":1}
I20260807 19:49:04.764000 25096 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.713199 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:54943)
0807 19:49:04.732056 (+ 18857us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:04.732083 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:04.734364 (+ 2281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:04.735873 (+ 1509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:04.735889 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:04.737178 (+ 1289us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:04.738575 (+ 1397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:04.738606 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.740492 (+ 1886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.740500 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:04.743688 (+ 3188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:04.743704 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.745311 (+ 1607us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.745320 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:04.745772 (+ 452us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.747259 (+ 1487us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:04.747298 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:04.751700 (+ 4402us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:04.757327 (+ 5627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:04.757332 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:04.757337 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:04.758211 (+ 874us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:04.758787 (+ 576us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:04.758792 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:04.758795 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:04.758998 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:04.759874 (+ 876us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:04.759882 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:04.760049 (+ 167us) client_negotiation.cc:769] Sending connection context
0807 19:49:04.761297 (+ 1248us) client_negotiation.cc:240] Negotiation successful
0807 19:49:04.762137 (+ 840us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18678,"mutex_wait_us":701,"spinlock_wait_cycles":25984,"thread_start_us":19401,"threads_started":1}
I20260807 19:49:04.764029 25092 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.712189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.12.155.130:58383)
0807 19:49:04.729357 (+ 17168us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:04.729447 (+ 90us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:04.734360 (+ 4913us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:04.735873 (+ 1513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:04.735887 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:04.737161 (+ 1274us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:04.738574 (+ 1413us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:04.738604 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.740491 (+ 1887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.740499 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:04.743723 (+ 3224us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:04.743732 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.745247 (+ 1515us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.745255 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:04.746364 (+ 1109us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.746952 (+ 588us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:04.746969 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:04.750754 (+ 3785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:04.756162 (+ 5408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:04.756174 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:04.756199 (+ 25us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:04.757035 (+ 836us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:04.757640 (+ 605us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:04.757645 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:04.757648 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:04.758032 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:04.758924 (+ 892us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:04.758936 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:04.759534 (+ 598us) client_negotiation.cc:769] Sending connection context
0807 19:49:04.761164 (+ 1630us) client_negotiation.cc:240] Negotiation successful
0807 19:49:04.761983 (+ 819us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16660,"mutex_wait_us":583,"spinlock_wait_cycles":33024,"thread_start_us":16267,"threads_started":1}
I20260807 19:49:04.765882 25095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:04.712188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.12.155.130:41987)
0807 19:49:04.733177 (+ 20989us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:04.733194 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:04.734360 (+ 1166us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:04.735873 (+ 1513us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:04.735887 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:04.737143 (+ 1256us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:04.738574 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:04.738604 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.740631 (+ 2027us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.740639 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:04.743691 (+ 3052us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:04.743707 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:04.745248 (+ 1541us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:04.745255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:04.745762 (+ 507us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:04.746848 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:04.746919 (+ 71us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:04.751927 (+ 5008us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:04.757124 (+ 5197us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:04.757129 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:04.757132 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:04.757853 (+ 721us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:04.758550 (+ 697us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:04.758557 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:04.758562 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:04.759211 (+ 649us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:04.760106 (+ 895us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:04.760114 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:04.760283 (+ 169us) client_negotiation.cc:769] Sending connection context
0807 19:49:04.763212 (+ 2929us) client_negotiation.cc:240] Negotiation successful
0807 19:49:04.763693 (+ 481us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20800,"mutex_wait_us":1776,"spinlock_wait_cycles":27904,"thread_start_us":18119,"threads_started":1}
I20260807 19:49:04.766407 25084 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44549
I20260807 19:49:04.767022 25084 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:04.767746 25080 heartbeater.cc:347] Connected to a master server at 127.12.155.188:38351
I20260807 19:49:04.767918 25080 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:04.768383 25084 heartbeater.cc:511] Master 127.12.155.190:44549 requested a full tablet report, sending...
I20260807 19:49:04.768523 25080 heartbeater.cc:511] Master 127.12.155.188:38351 requested a full tablet report, sending...
I20260807 19:49:04.766500 25087 heartbeater.cc:347] Connected to a master server at 127.12.155.189:35731
I20260807 19:49:04.768929 25087 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:04.769501 25087 heartbeater.cc:511] Master 127.12.155.189:35731 requested a full tablet report, sending...
I20260807 19:49:04.770749 23251 ts_manager.cc:194] Re-registered known tserver with Master: fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363)
I20260807 19:49:04.770785 24554 ts_manager.cc:194] Registered new tserver with Master: fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363)
I20260807 19:49:04.770818 24263 ts_manager.cc:194] Registered new tserver with Master: fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363)
I20260807 19:49:04.772143 23251 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:54943
I20260807 19:49:04.888614 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 23793
I20260807 19:49:04.920707 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:35151
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:44549
--webserver_port=37677
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40995
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:05.009418 24846 heartbeater.cc:503] Master 127.12.155.190:44549 was elected leader, sending a full tablet report...
W20260807 19:49:05.346180 25103 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:05.346596 25103 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:05.346868 25103 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:05.355087 25103 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:05.355248 25103 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:05.355444 25103 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:05.366878 25103 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40995
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:35151
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=37677
--tserver_master_addrs=127.12.155.190:44549,127.12.155.189:35731,127.12.155.188:38351
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:05.368790 25103 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:05.370648 25103 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:05.387858 25110 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:05.387889 25121 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:05.387857 25114 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:05.389323 25103 server_base.cc:1034] running on GCE node
I20260807 19:49:05.390101 25103 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:05.391350 25103 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:05.392570 25103 hybrid_clock.cc:648] HybridClock initialized: now 1786132145392494 us; error 70 us; skew 500 ppm
I20260807 19:49:05.392967 25103 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:05 dist-test-slave-2p8l krb5kdc[23183](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132145, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:05.397101 25103 init.cc:377] Logged in from keytab as oryx/127.12.155.131@KRBTEST.COM (short username oryx)
I20260807 19:49:05.399001 25103 webserver.cc:460] Webserver started at http://127.12.155.131:37677/ using document root <none> and password file <none>
I20260807 19:49:05.399875 25103 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:05.400040 25103 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:05.406878 25103 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:49:05.410549 25134 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:05.412328 25103 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:05.412544 25103 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "a9357ed3544e471f8223ce65a096c934"
format_stamp: "Formatted at 2026-08-07 19:49:01 on dist-test-slave-2p8l"
server_key: "74368bf413a1fd476f99e793ecf8a58c"
server_key_iv: "86e999f5839b8769ffd19528130b88a3"
server_key_version: "encryptionkey@0"
I20260807 19:49:05.413901 25103 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:05.432749 25103 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:05.438141 25103 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:05.438511 25103 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:05.439759 25103 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:05.441664 25103 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:05.441800 25103 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:05.441936 25103 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:05.442031 25103 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:05.482367 25103 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:35151
I20260807 19:49:05.482426 25308 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:35151 every 8 connection(s)
I20260807 19:49:05.484234 25103 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:05.485205 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 25103
Aug 07 19:49:05 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132145, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.189@KRBTEST.COM
Aug 07 19:49:05 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132145, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.188@KRBTEST.COM
I20260807 19:49:05.551807 25322 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.489973 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:59815 (local address 127.12.155.189:35731)
0807 19:49:05.515085 (+ 25112us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.515097 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.522333 (+ 7236us) server_negotiation.cc:407] Connection header received
0807 19:49:05.525929 (+ 3596us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.525941 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.526157 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.526345 (+ 188us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.529858 (+ 3513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.530985 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.532931 (+ 1946us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.533416 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.533569 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.539878 (+ 6309us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.539888 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.539896 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.539949 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.544843 (+ 4894us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.547241 (+ 2398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.547275 (+ 34us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.547280 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.547624 (+ 344us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.548517 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.548524 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.548528 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.549166 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.549396 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.550942 (+ 1546us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.551306 (+ 364us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":24864,"thread_start_us":25122,"threads_started":1}
I20260807 19:49:05.554533 25324 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.489309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.12.155.131:59815)
0807 19:49:05.522138 (+ 32829us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.522173 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.525433 (+ 3260us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.526713 (+ 1280us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.526729 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.528195 (+ 1466us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:05.529547 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.529614 (+ 67us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.531159 (+ 1545us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.531165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.532784 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.532800 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.533703 (+ 903us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.533711 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.534125 (+ 414us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.535080 (+ 955us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:05.535115 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:05.539586 (+ 4471us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:05.545045 (+ 5459us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:05.545057 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:05.545088 (+ 31us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:05.547021 (+ 1933us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:05.547901 (+ 880us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:05.547906 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:05.547910 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:05.548244 (+ 334us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:05.549526 (+ 1282us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:05.549539 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:05.550286 (+ 747us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.550788 (+ 502us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.551553 (+ 765us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":32634,"thread_start_us":28759,"threads_started":1}
I20260807 19:49:05.556898 25311 heartbeater.cc:347] Connected to a master server at 127.12.155.189:35731
I20260807 19:49:05.557544 25311 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:05.558925 25311 heartbeater.cc:511] Master 127.12.155.189:35731 requested a full tablet report, sending...
I20260807 19:49:05.561733 24263 ts_manager.cc:194] Registered new tserver with Master: a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
Aug 07 19:49:05 dist-test-slave-2p8l krb5kdc[23183](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132145, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:05.569845 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.515381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60482 (local address 127.12.155.189:35731)
0807 19:49:05.526672 (+ 11291us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.526680 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.526703 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:49:05.527003 (+ 300us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.527010 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.527106 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.527230 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.530682 (+ 3452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.532540 (+ 1858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.537192 (+ 4652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.537992 (+ 800us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.538199 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.558320 (+ 20121us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.558328 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.558333 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.558379 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.563768 (+ 5389us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.566254 (+ 2486us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.566263 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.566270 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.566498 (+ 228us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.567176 (+ 678us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.567184 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.567190 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.567732 (+ 542us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.568038 (+ 306us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.568916 (+ 878us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.569319 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":8376,"thread_start_us":8470,"threads_started":1}
I20260807 19:49:05.571240 25320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.489872 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:53975 (local address 127.12.155.188:38351)
0807 19:49:05.524223 (+ 34351us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.524233 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.524275 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:49:05.530025 (+ 5750us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.530037 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.530189 (+ 152us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.530326 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.534343 (+ 4017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.536046 (+ 1703us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.538680 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.539836 (+ 1156us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.539970 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.557917 (+ 17947us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.557927 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.557936 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.557995 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.565533 (+ 7538us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.566652 (+ 1119us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.566659 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.566663 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.566865 (+ 202us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.567365 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.567370 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.567374 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.568692 (+ 1318us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.568854 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.570426 (+ 1572us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.570752 (+ 326us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":34174,"thread_start_us":33906,"threads_started":1}
I20260807 19:49:05.571918 25318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.489038 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.12.155.131:53975)
0807 19:49:05.519816 (+ 30778us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.519901 (+ 85us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.525440 (+ 5539us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.532841 (+ 7401us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.532850 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.533621 (+ 771us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:05.534042 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.534079 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.536303 (+ 2224us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.536312 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.538446 (+ 2134us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.538468 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.540290 (+ 1822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.540296 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.540486 (+ 190us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.542146 (+ 1660us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:05.542180 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:05.551785 (+ 9605us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:05.565848 (+ 14063us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:05.565854 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:05.565859 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:05.566477 (+ 618us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:05.567015 (+ 538us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:05.567020 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:05.567024 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:05.567212 (+ 188us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:05.568809 (+ 1597us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:05.568814 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:05.569005 (+ 191us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.569153 (+ 148us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.569568 (+ 415us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":28652,"thread_start_us":35822,"threads_started":1}
I20260807 19:49:05.573649 25309 heartbeater.cc:347] Connected to a master server at 127.12.155.188:38351
I20260807 19:49:05.573848 25309 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:05.574563 25309 heartbeater.cc:511] Master 127.12.155.188:38351 requested a full tablet report, sending...
I20260807 19:49:05.576407 24554 ts_manager.cc:194] Registered new tserver with Master: a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:05.578184 25314 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.488073 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:55031 (local address 127.12.155.190:44549)
0807 19:49:05.506674 (+ 18601us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.506686 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.525022 (+ 18336us) server_negotiation.cc:407] Connection header received
0807 19:49:05.526983 (+ 1961us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.526993 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.527101 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.527226 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.537176 (+ 9950us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.538415 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.547967 (+ 9552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.549885 (+ 1918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.550171 (+ 286us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.567894 (+ 17723us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.567902 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.567908 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.567956 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.572728 (+ 4772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.574028 (+ 1300us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.574034 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.574037 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.574300 (+ 263us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.575076 (+ 776us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.575081 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.575083 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.576842 (+ 1759us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.577175 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.577488 (+ 313us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.577742 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":18356,"thread_start_us":18623,"threads_started":1}
I20260807 19:49:05.578230 25316 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.490436 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:55031)
0807 19:49:05.524874 (+ 34438us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.524899 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.526791 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.527539 (+ 748us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.527577 (+ 38us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.536433 (+ 8856us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:05.536946 (+ 513us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.536964 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.545615 (+ 8651us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.545623 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.547682 (+ 2059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.547698 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.552378 (+ 4680us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.552384 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.552544 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.555450 (+ 2906us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:05.555478 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:05.567654 (+ 12176us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:05.573064 (+ 5410us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:05.573069 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:05.573074 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:05.573874 (+ 800us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:05.574438 (+ 564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:05.574444 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:05.574453 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:05.574674 (+ 221us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:05.576976 (+ 2302us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:05.576981 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:05.577187 (+ 206us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.577359 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.577733 (+ 374us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":34266,"thread_start_us":31924,"threads_started":1}
I20260807 19:49:05.579432 25310 heartbeater.cc:347] Connected to a master server at 127.12.155.190:44549
I20260807 19:49:05.579615 25310 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:05.580192 25310 heartbeater.cc:511] Master 127.12.155.190:44549 requested a full tablet report, sending...
I20260807 19:49:05.581305 25330 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.510030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42938 (local address 127.12.155.190:44549)
0807 19:49:05.528140 (+ 18110us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.528146 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.553602 (+ 25456us) server_negotiation.cc:407] Connection header received
0807 19:49:05.553975 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.553983 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.554160 (+ 177us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.554306 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.561694 (+ 7388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.563487 (+ 1793us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.565546 (+ 2059us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.566526 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.566652 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.571944 (+ 5292us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.571952 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.571958 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.572033 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.577529 (+ 5496us) spinlock_profiling.cc:243] Waited 901 us on lock 0x60c0000347b8. stack: 00007f39523f966e 00007f39523f9430 00007f39514805ed 00000000008ea064 00000000008ea02d 00000000008e99fa 00007f39523ef0fd 00007f39523ef977 00007f3958f0669d 00007f3958f22963 00007f3958f1c01e 00007f3958f158a5 00007f3958e83ea5 00007f3958e82eff 00007f3958eb682f 00007f3958eb658d
0807 19:49:05.577581 (+ 52us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.578655 (+ 1074us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.578661 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.578665 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.578876 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.579515 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.579521 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.579524 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.579933 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.580240 (+ 307us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.580647 (+ 407us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.580914 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17975,"spinlock_wait_cycles":2072832,"thread_start_us":17796,"threads_started":1}
I20260807 19:49:05.583019 23252 ts_manager.cc:194] Re-registered known tserver with Master: a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:05.584672 23252 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:55031
I20260807 19:49:05.585280 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.514492 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59370 (local address 127.12.155.188:38351)
0807 19:49:05.543423 (+ 28931us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.543431 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.543457 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:49:05.543521 (+ 64us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.543530 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.543690 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.543835 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.548072 (+ 4237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.549803 (+ 1731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.556820 (+ 7017us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.560865 (+ 4045us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.561011 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.574671 (+ 13660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.574679 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.574684 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.574730 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.578928 (+ 4198us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.579858 (+ 930us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.579864 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.579868 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.580043 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.580523 (+ 480us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.580528 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.580531 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.581301 (+ 770us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.581629 (+ 328us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.583568 (+ 1939us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.583883 (+ 315us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":28712,"thread_start_us":35592,"threads_started":1}
I20260807 19:49:05.588801 23252 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42938:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:49:05.597594 23252 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:05.650197 25368 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.625308 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:36363 (local address 127.0.0.1:33332)
0807 19:49:05.632918 (+ 7610us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.632955 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.633337 (+ 382us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.638296 (+ 4959us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.638305 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.638753 (+ 448us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:05.639280 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.639295 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.642384 (+ 3089us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.642390 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.645738 (+ 3348us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.645759 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.649141 (+ 3382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.649148 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.649387 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.649432 (+ 45us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.649545 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.649722 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":7322,"thread_start_us":6976,"threads_started":1}
I20260807 19:49:05.650957 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.625794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33332 (local address 127.12.155.130:36363)
0807 19:49:05.636176 (+ 10382us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.636192 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.636244 (+ 52us) server_negotiation.cc:407] Connection header received
0807 19:49:05.636426 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.636441 (+ 15us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.637300 (+ 859us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.637958 (+ 658us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:05.639551 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.641978 (+ 2427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.645972 (+ 3994us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.648384 (+ 2412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.648650 (+ 266us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.648954 (+ 304us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.650232 (+ 1278us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.650642 (+ 410us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10103,"thread_start_us":9905,"threads_started":1}
I20260807 19:49:05.653200 25370 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.625999 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45995 (local address 127.0.0.1:50198)
0807 19:49:05.634804 (+ 8805us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.634841 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.635180 (+ 339us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.642383 (+ 7203us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.642389 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.642426 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:05.643061 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.643078 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.645935 (+ 2857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.645945 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.649086 (+ 3141us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.649100 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.651919 (+ 2819us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.651925 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.652258 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.652326 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.652410 (+ 84us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.652697 (+ 287us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8507,"mutex_wait_us":81,"thread_start_us":8343,"threads_started":1}
I20260807 19:49:05.653617 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.626442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50198 (local address 127.12.155.129:45995)
0807 19:49:05.640292 (+ 13850us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.640304 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.640359 (+ 55us) server_negotiation.cc:407] Connection header received
0807 19:49:05.640493 (+ 134us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.640504 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.641941 (+ 1437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.643424 (+ 1483us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:05.643802 (+ 378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.645711 (+ 1909us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.649277 (+ 3566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.651595 (+ 2318us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.652710 (+ 1115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.652960 (+ 250us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.653058 (+ 98us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.653261 (+ 203us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13542,"thread_start_us":15148,"threads_started":1}
I20260807 19:49:05.656381 24982 tablet_service.cc:1467] Processing CreateTablet for tablet c59565e9484742919c0ae8edb5fcea0d (DEFAULT_TABLE table=test-table [id=d1d4af77c18e478aa03b9ea666911cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:05.658756 24982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59565e9484742919c0ae8edb5fcea0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:05.658355 24732 tablet_service.cc:1467] Processing CreateTablet for tablet c59565e9484742919c0ae8edb5fcea0d (DEFAULT_TABLE table=test-table [id=d1d4af77c18e478aa03b9ea666911cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:05.660183 24732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59565e9484742919c0ae8edb5fcea0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:05.665827 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.635314 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45888 (local address 127.12.155.131:35151)
0807 19:49:05.641607 (+ 6293us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.641617 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.646967 (+ 5350us) server_negotiation.cc:407] Connection header received
0807 19:49:05.647218 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.647230 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.647635 (+ 405us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.648068 (+ 433us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:05.649652 (+ 1584us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.651570 (+ 1918us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.662252 (+ 10682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.664176 (+ 1924us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.664500 (+ 324us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.664739 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.665240 (+ 501us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.665451 (+ 211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6062,"thread_start_us":5851,"threads_started":1}
I20260807 19:49:05.665849 25375 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.639535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35151 (local address 127.0.0.1:45888)
0807 19:49:05.646585 (+ 7050us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.646613 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.646970 (+ 357us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.648058 (+ 1088us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.648064 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.648099 (+ 35us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:05.648973 (+ 874us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.648997 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.651736 (+ 2739us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.651742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.654981 (+ 3239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.655003 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.664618 (+ 9615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.664637 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.664954 (+ 317us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.665009 (+ 55us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.665164 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.665372 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6861,"thread_start_us":6604,"threads_started":1}
I20260807 19:49:05.671737 25208 tablet_service.cc:1467] Processing CreateTablet for tablet c59565e9484742919c0ae8edb5fcea0d (DEFAULT_TABLE table=test-table [id=d1d4af77c18e478aa03b9ea666911cc9]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:05.674237 25208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c59565e9484742919c0ae8edb5fcea0d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:05.678876 25376 tablet_bootstrap.cc:492] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Bootstrap starting.
I20260807 19:49:05.681862 25377 tablet_bootstrap.cc:492] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Bootstrap starting.
I20260807 19:49:05.684633 25376 tablet_bootstrap.cc:654] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:05.686616 25377 tablet_bootstrap.cc:654] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:05.686734 25376 log.cc:824] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:05.688704 25377 log.cc:824] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:05.691299 25376 tablet_bootstrap.cc:492] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: No bootstrap required, opened a new log
I20260807 19:49:05.691730 25376 ts_tablet_manager.cc:1397] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Time spent bootstrapping tablet: real 0.013s user 0.009s sys 0.002s
I20260807 19:49:05.692893 25377 tablet_bootstrap.cc:492] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: No bootstrap required, opened a new log
I20260807 19:49:05.693243 25377 ts_tablet_manager.cc:1397] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260807 19:49:05.694054 25385 tablet_bootstrap.cc:492] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Bootstrap starting.
I20260807 19:49:05.699549 25385 tablet_bootstrap.cc:654] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:05.700963 25385 log.cc:824] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:05.705295 25385 tablet_bootstrap.cc:492] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: No bootstrap required, opened a new log
I20260807 19:49:05.705698 25385 ts_tablet_manager.cc:1397] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Time spent bootstrapping tablet: real 0.012s user 0.006s sys 0.003s
I20260807 19:49:05.707315 25376 raft_consensus.cc:348] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.708125 25376 raft_consensus.cc:374] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:05.708375 25376 raft_consensus.cc:729] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a968bf47dde475794cf3d231c9ecb58, State: Initialized, Role: FOLLOWER
I20260807 19:49:05.707966 25377 raft_consensus.cc:348] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.708751 25377 raft_consensus.cc:374] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:05.708902 25377 raft_consensus.cc:729] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc57c251e3044bd79497324d416183d5, State: Initialized, Role: FOLLOWER
I20260807 19:49:05.709697 25376 consensus_queue.cc:260] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.709908 25377 consensus_queue.cc:260] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.718134 25385 raft_consensus.cc:348] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.718720 25385 raft_consensus.cc:374] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:05.718837 25385 raft_consensus.cc:729] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9357ed3544e471f8223ce65a096c934, State: Initialized, Role: FOLLOWER
I20260807 19:49:05.718871 25377 ts_tablet_manager.cc:1428] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Time spent starting tablet: real 0.025s user 0.018s sys 0.009s
I20260807 19:49:05.718871 25376 ts_tablet_manager.cc:1428] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Time spent starting tablet: real 0.027s user 0.020s sys 0.007s
I20260807 19:49:05.719239 25084 heartbeater.cc:503] Master 127.12.155.190:44549 was elected leader, sending a full tablet report...
I20260807 19:49:05.719697 25385 consensus_queue.cc:260] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
W20260807 19:49:05.721566 24849 tablet.cc:2369] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:05.731268 25310 heartbeater.cc:503] Master 127.12.155.190:44549 was elected leader, sending a full tablet report...
I20260807 19:49:05.732223 25385 ts_tablet_manager.cc:1428] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Time spent starting tablet: real 0.026s user 0.009s sys 0.013s
W20260807 19:49:05.754581 25325 tablet.cc:2369] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:05.765331 25388 raft_consensus.cc:482] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:05.765950 25388 raft_consensus.cc:504] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.769058 25388 leader_election.cc:288] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995), a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:05.777670 25372 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.769507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:56717 (local address 127.12.155.129:45995)
0807 19:49:05.769798 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.769804 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.770784 (+ 980us) server_negotiation.cc:407] Connection header received
0807 19:49:05.771361 (+ 577us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.771368 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.771502 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.771607 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:05.772515 (+ 908us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.773518 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.775734 (+ 2216us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.776610 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.776837 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.776933 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.777202 (+ 269us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.777364 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:49:05.778046 25374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.770941 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:46231 (local address 127.12.155.131:35151)
0807 19:49:05.771205 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.771215 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.771837 (+ 622us) server_negotiation.cc:407] Connection header received
0807 19:49:05.772106 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.772110 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.772190 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.772299 (+ 109us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:05.772961 (+ 662us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.773764 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.776100 (+ 2336us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.776911 (+ 811us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.777125 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.777230 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.777640 (+ 410us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.777787 (+ 147us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:49:05.778568 25391 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.769299 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45995 (local address 127.12.155.130:56717)
0807 19:49:05.770511 (+ 1212us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.770536 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.771020 (+ 484us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.771846 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.771850 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.771886 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:05.772354 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.772365 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.773664 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.773670 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.775553 (+ 1883us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.775566 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.776842 (+ 1276us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.776849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.777019 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.777048 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.777161 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.777333 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1053,"spinlock_wait_cycles":6528,"thread_start_us":799,"threads_started":1}
I20260807 19:49:05.778831 25393 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.770733 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35151 (local address 127.12.155.130:46231)
0807 19:49:05.771596 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:05.771611 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:05.771925 (+ 314us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:05.772338 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:05.772342 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:05.772368 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:05.772784 (+ 416us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.772800 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.773898 (+ 1098us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.773906 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.775930 (+ 2024us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:05.775942 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.777228 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.777235 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:05.777474 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.777503 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:49:05.777610 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 19:49:05.777758 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":715,"spinlock_wait_cycles":1920,"thread_start_us":544,"threads_started":1}
I20260807 19:49:05.780114 24774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59565e9484742919c0ae8edb5fcea0d" candidate_uuid: "fc57c251e3044bd79497324d416183d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a968bf47dde475794cf3d231c9ecb58" is_pre_election: true
I20260807 19:49:05.780467 25247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59565e9484742919c0ae8edb5fcea0d" candidate_uuid: "fc57c251e3044bd79497324d416183d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9357ed3544e471f8223ce65a096c934" is_pre_election: true
I20260807 19:49:05.780876 24774 raft_consensus.cc:2454] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc57c251e3044bd79497324d416183d5 in term 0.
I20260807 19:49:05.781500 25247 raft_consensus.cc:2454] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate fc57c251e3044bd79497324d416183d5 in term 0.
I20260807 19:49:05.782173 24907 leader_election.cc:302] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a968bf47dde475794cf3d231c9ecb58, fc57c251e3044bd79497324d416183d5; no voters:
I20260807 19:49:05.782934 25388 raft_consensus.cc:2781] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:05.783185 25388 raft_consensus.cc:482] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:05.783310 25388 raft_consensus.cc:3037] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:05.786907 25388 raft_consensus.cc:504] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.787681 25388 leader_election.cc:288] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [CANDIDATE]: Term 1 election: Requested vote from peers 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995), a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:05.788463 25247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59565e9484742919c0ae8edb5fcea0d" candidate_uuid: "fc57c251e3044bd79497324d416183d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9357ed3544e471f8223ce65a096c934"
I20260807 19:49:05.788461 24774 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c59565e9484742919c0ae8edb5fcea0d" candidate_uuid: "fc57c251e3044bd79497324d416183d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0a968bf47dde475794cf3d231c9ecb58"
I20260807 19:49:05.788720 25247 raft_consensus.cc:3037] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:05.788810 24774 raft_consensus.cc:3037] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:05.792167 24774 raft_consensus.cc:2454] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc57c251e3044bd79497324d416183d5 in term 1.
I20260807 19:49:05.792781 24907 leader_election.cc:302] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a968bf47dde475794cf3d231c9ecb58, fc57c251e3044bd79497324d416183d5; no voters:
I20260807 19:49:05.793200 25247 raft_consensus.cc:2454] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate fc57c251e3044bd79497324d416183d5 in term 1.
I20260807 19:49:05.793334 25388 raft_consensus.cc:2781] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:05.794353 25388 raft_consensus.cc:686] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 1 LEADER]: Becoming Leader. State: Replica: fc57c251e3044bd79497324d416183d5, State: Running, Role: LEADER
I20260807 19:49:05.795255 25388 consensus_queue.cc:237] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:05.803390 23252 catalog_manager.cc:5495] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to fc57c251e3044bd79497324d416183d5 (127.12.155.130). New cstate: current_term: 1 leader_uuid: "fc57c251e3044bd79497324d416183d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } health_report { overall_health: UNKNOWN } } }
I20260807 19:49:05.847131 25369 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.839951 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33336 (local address 127.12.155.130:36363)
0807 19:49:05.840180 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.840185 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.840206 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:49:05.840430 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.840435 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.840553 (+ 118us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.840811 (+ 258us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:05.841248 (+ 437us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.842306 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.844121 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.844588 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.844702 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.845406 (+ 704us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:05.846346 (+ 940us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:05.846522 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.846607 (+ 85us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.846726 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:49:05.858856 24774 raft_consensus.cc:1261] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Refusing update from remote peer fc57c251e3044bd79497324d416183d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:05.858919 25247 raft_consensus.cc:1261] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Refusing update from remote peer fc57c251e3044bd79497324d416183d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:05.860251 25395 consensus_queue.cc:1035] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:05.861020 25388 consensus_queue.cc:1035] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:05.883138 25400 mvcc.cc:205] Tried to move back new op lower bound from 7315997269423534080 to 7315997269182795776. Current Snapshot: MvccSnapshot[applied={T|T < 7315997269423534080}]
I20260807 19:49:05.912360 23252 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:05.912757 23252 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:42938:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:05.921761 23252 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 25e97a7361944c7394809e39705da6d6: Sending DeleteTablet for 3 replicas of tablet c59565e9484742919c0ae8edb5fcea0d
I20260807 19:49:05.923913 24982 tablet_service.cc:1514] Processing DeleteTablet for tablet c59565e9484742919c0ae8edb5fcea0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:05 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:33332
I20260807 19:49:05.924314 24732 tablet_service.cc:1514] Processing DeleteTablet for tablet c59565e9484742919c0ae8edb5fcea0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:05 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:50198
I20260807 19:49:05.924430 25208 tablet_service.cc:1514] Processing DeleteTablet for tablet c59565e9484742919c0ae8edb5fcea0d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:05 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:45888
I20260807 19:49:05.937875 25412 tablet_replica.cc:330] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: stopping tablet replica
I20260807 19:49:05.939111 25412 raft_consensus.cc:2229] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:05.939461 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 23202
I20260807 19:49:05.941282 23298 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:05.942896 25412 raft_consensus.cc:2258] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:05.945398 25415 tablet_replica.cc:330] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: stopping tablet replica
I20260807 19:49:05.946125 25415 raft_consensus.cc:2229] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:05.946841 25415 raft_consensus.cc:2258] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:05.948520 25412 ts_tablet_manager.cc:1905] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:05.951900 25414 tablet_replica.cc:330] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: stopping tablet replica
I20260807 19:49:05.952579 25414 raft_consensus.cc:2229] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:05.953426 25414 raft_consensus.cc:2258] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:05.958511 25415 ts_tablet_manager.cc:1905] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:05.961159 25414 ts_tablet_manager.cc:1905] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:05.973839 25412 ts_tablet_manager.cc:1918] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:05.976421 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.928039 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60488 (local address 127.12.155.189:35731)
0807 19:49:05.928325 (+ 286us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.928336 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.937193 (+ 8857us) server_negotiation.cc:407] Connection header received
0807 19:49:05.940555 (+ 3362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.940564 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.940681 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.940773 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.947133 (+ 6360us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.948397 (+ 1264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.955034 (+ 6637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.955801 (+ 767us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.955954 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.967062 (+ 11108us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.967073 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.967078 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.967138 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.972147 (+ 5009us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.973369 (+ 1222us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.973378 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.973385 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.973593 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.974143 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.974148 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.974151 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:05.974625 (+ 474us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:05.974918 (+ 293us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:05.975675 (+ 757us) server_negotiation.cc:299] Negotiation successful
0807 19:49:05.975981 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:49:05.977036 25412 log.cc:1196] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/c59565e9484742919c0ae8edb5fcea0d
I20260807 19:49:05.977878 25412 ts_tablet_manager.cc:1939] T c59565e9484742919c0ae8edb5fcea0d P fc57c251e3044bd79497324d416183d5: Deleting consensus metadata
I20260807 19:49:05.978749 25414 ts_tablet_manager.cc:1918] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:05.982309 25414 log.cc:1196] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/c59565e9484742919c0ae8edb5fcea0d
I20260807 19:49:05.983369 25414 ts_tablet_manager.cc:1939] T c59565e9484742919c0ae8edb5fcea0d P 0a968bf47dde475794cf3d231c9ecb58: Deleting consensus metadata
I20260807 19:49:05.983847 25415 ts_tablet_manager.cc:1918] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:05.984874 25415 log.cc:1196] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/c59565e9484742919c0ae8edb5fcea0d
I20260807 19:49:05.988548 25415 ts_tablet_manager.cc:1939] T c59565e9484742919c0ae8edb5fcea0d P a9357ed3544e471f8223ce65a096c934: Deleting consensus metadata
I20260807 19:49:06.002738 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:05.938127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59372 (local address 127.12.155.188:38351)
0807 19:49:05.938362 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:05.938369 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:05.984433 (+ 46064us) server_negotiation.cc:407] Connection header received
0807 19:49:05.984711 (+ 278us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:05.984719 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:05.984870 (+ 151us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:05.984994 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:05.987854 (+ 2860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.989127 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.991013 (+ 1886us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:05.991590 (+ 577us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:05.991755 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:05.995355 (+ 3600us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:05.995361 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:05.995364 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:05.995405 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:05.998796 (+ 3391us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:05.999893 (+ 1097us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:05.999905 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:05.999908 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:06.000076 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:06.000571 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:06.000577 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:06.000587 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:06.001056 (+ 469us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:06.001381 (+ 325us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:06.001818 (+ 437us) server_negotiation.cc:299] Negotiation successful
0807 19:49:06.002154 (+ 336us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:49:06.158423 23230 catalog_manager.cc:4841] TS a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151): tablet c59565e9484742919c0ae8edb5fcea0d (table test-table [id=d1d4af77c18e478aa03b9ea666911cc9]) successfully deleted
I20260807 19:49:06.159564 23221 catalog_manager.cc:4841] TS fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363): tablet c59565e9484742919c0ae8edb5fcea0d (table test-table [id=d1d4af77c18e478aa03b9ea666911cc9]) successfully deleted
I20260807 19:49:06.159574 23230 catalog_manager.cc:4841] TS 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995): tablet c59565e9484742919c0ae8edb5fcea0d (table test-table [id=d1d4af77c18e478aa03b9ea666911cc9]) successfully deleted
I20260807 19:49:06.160674 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 23202
I20260807 19:49:06.233299 25338 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:06.205830 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46236 (local address 127.12.155.188:38351)
0807 19:49:06.206107 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:06.206115 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:06.210500 (+ 4385us) server_negotiation.cc:407] Connection header received
0807 19:49:06.210731 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:06.210737 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:06.210832 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:06.210908 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:06.213092 (+ 2184us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:06.214915 (+ 1823us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:06.216995 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:06.217735 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:06.217875 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:06.226261 (+ 8386us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:06.226270 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:06.226275 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:06.226334 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:06.229776 (+ 3442us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:06.230670 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:06.230676 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:06.230679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:06.230838 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:06.231323 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:06.231327 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:06.231330 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:06.231846 (+ 516us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:06.232165 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:06.232531 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 19:49:06.232832 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:49:06.234349 25342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:06.206224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38304 (local address 127.12.155.189:35731)
0807 19:49:06.206471 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:06.206481 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:06.210254 (+ 3773us) server_negotiation.cc:407] Connection header received
0807 19:49:06.210595 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:06.210603 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:06.210715 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:06.210816 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:06.215452 (+ 4636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:06.216392 (+ 940us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:06.218366 (+ 1974us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:06.219097 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:06.219260 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:06.226505 (+ 7245us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:06.226513 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:06.226520 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:06.226568 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:06.230293 (+ 3725us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:06.231113 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:06.231120 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:06.231125 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:06.231290 (+ 165us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:06.231722 (+ 432us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:06.231727 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:06.231731 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:06.232113 (+ 382us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:06.232398 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:06.233525 (+ 1127us) server_negotiation.cc:299] Negotiation successful
0807 19:49:06.233774 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 19:49:06.889932 25430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:06.888981 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:39559)
0807 19:49:06.889544 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:06.889701 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":282,"threads_started":1}
W20260807 19:49:06.890530 24846 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:44549 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:06.894640 25431 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:06.893589 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:58889)
0807 19:49:06.894195 (+ 606us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:06.894376 (+ 181us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":453,"thread_start_us":330,"threads_started":1}
W20260807 19:49:06.895130 25310 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:44549 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:06.902709 25432 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:06.901636 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:57813)
0807 19:49:06.902296 (+ 660us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:06.902454 (+ 158us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":527,"thread_start_us":307,"threads_started":1}
W20260807 19:49:06.903194 25084 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:44549 (0 consecutive failures): Network error: Failed to send heartbeat to master: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:07.422442 25433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25e97a7361944c7394809e39705da6d6)
I20260807 19:49:07.422931 25433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:07.423319 25434 raft_consensus.cc:482] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 25e97a7361944c7394809e39705da6d6)
I20260807 19:49:07.423563 25434 raft_consensus.cc:504] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:07.424499 25434 leader_election.cc:288] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549), 54c1596155894af490c826081bf8562f (127.12.155.188:38351)
I20260807 19:49:07.425120 25433 leader_election.cc:288] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549), a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189:35731)
I20260807 19:49:07.434154 25436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.425079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60278)
0807 19:49:07.433372 (+ 8293us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.433644 (+ 272us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":8099,"threads_started":1}
I20260807 19:49:07.435645 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.424780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60268)
0807 19:49:07.434863 (+ 10083us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.435117 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":9948,"thread_start_us":9790,"threads_started":1}
W20260807 19:49:07.435819 24529 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
W20260807 19:49:07.439682 24236 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:07.439941 25436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.439274 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60304)
0807 19:49:07.439528 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.439643 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":138}
W20260807 19:49:07.440240 24529 leader_election.cc:334] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:07.442375 25445 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.441631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60312)
0807 19:49:07.441862 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.442113 (+ 251us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 19:49:07.442760 24236 leader_election.cc:334] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:07.445262 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.425777 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:38351 (local address 127.0.0.1:46252)
0807 19:49:07.436128 (+ 10351us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.436149 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:07.436452 (+ 303us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:07.437224 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:07.437232 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:07.437270 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:07.437850 (+ 580us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:07.437874 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.440147 (+ 2273us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.440153 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:07.442748 (+ 2595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:07.442789 (+ 41us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.444391 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.444398 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:07.444611 (+ 213us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:07.444658 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 19:49:07.444763 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 19:49:07.444927 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10221,"thread_start_us":10306,"threads_started":1}
I20260807 19:49:07.445452 25440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.425064 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.12.155.188:38351)
0807 19:49:07.426846 (+ 1782us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:07.426856 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:07.436272 (+ 9416us) server_negotiation.cc:407] Connection header received
0807 19:49:07.436658 (+ 386us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:07.436667 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:07.436793 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:07.436889 (+ 96us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:07.438207 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.439944 (+ 1737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.442919 (+ 2975us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.444201 (+ 1282us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.444345 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:07.444499 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:07.444877 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 19:49:07.445039 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1600,"thread_start_us":1390,"threads_started":1}
I20260807 19:49:07.446585 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.425525 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35731 (local address 127.0.0.1:38314)
0807 19:49:07.435514 (+ 9989us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.435533 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:07.435677 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:07.439256 (+ 3579us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:07.439261 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:07.439291 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:07.439697 (+ 406us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:07.439711 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.441685 (+ 1974us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.441693 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:07.443804 (+ 2111us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:07.443824 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.445578 (+ 1754us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.445585 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:07.445815 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:07.445866 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 19:49:07.445957 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 19:49:07.446126 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9837,"mutex_wait_us":24,"thread_start_us":9691,"threads_started":1}
I20260807 19:49:07.446522 24568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a26b1f181f7c4eed8c88556fb8331580" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "54c1596155894af490c826081bf8562f" is_pre_election: true
I20260807 19:49:07.447052 25446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.434933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38314 (local address 127.12.155.189:35731)
0807 19:49:07.438930 (+ 3997us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:07.438936 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:07.438956 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:49:07.439017 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:07.439023 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:07.439100 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:07.439220 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:07.440018 (+ 798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.441539 (+ 1521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.443970 (+ 2431us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:07.445285 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:07.446361 (+ 1076us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:07.446441 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:07.446497 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 19:49:07.446664 (+ 167us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3875,"thread_start_us":4436,"threads_started":1}
I20260807 19:49:07.447275 24568 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a26b1f181f7c4eed8c88556fb8331580 in term 1.
I20260807 19:49:07.447713 24275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54c1596155894af490c826081bf8562f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a26b1f181f7c4eed8c88556fb8331580" is_pre_election: true
I20260807 19:49:07.447933 24234 leader_election.cc:302] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54c1596155894af490c826081bf8562f, a26b1f181f7c4eed8c88556fb8331580; no voters: 25e97a7361944c7394809e39705da6d6
I20260807 19:49:07.448099 24275 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54c1596155894af490c826081bf8562f in term 1.
I20260807 19:49:07.448519 25434 raft_consensus.cc:2781] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 19:49:07.448668 25434 raft_consensus.cc:482] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25e97a7361944c7394809e39705da6d6)
I20260807 19:49:07.448788 25434 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:49:07.448657 24525 leader_election.cc:302] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54c1596155894af490c826081bf8562f, a26b1f181f7c4eed8c88556fb8331580; no voters: 25e97a7361944c7394809e39705da6d6
I20260807 19:49:07.449124 25433 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Leader pre-election won for term 2
I20260807 19:49:07.449275 25433 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Starting leader election (detected failure of leader 25e97a7361944c7394809e39705da6d6)
I20260807 19:49:07.449383 25433 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:49:07.452457 25434 raft_consensus.cc:504] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:07.453002 25433 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:07.453461 25434 leader_election.cc:288] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 2 election: Requested vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549), 54c1596155894af490c826081bf8562f (127.12.155.188:38351)
I20260807 19:49:07.453958 25433 leader_election.cc:288] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 2 election: Requested vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549), a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189:35731)
I20260807 19:49:07.453941 24568 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "a26b1f181f7c4eed8c88556fb8331580" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "54c1596155894af490c826081bf8562f"
I20260807 19:49:07.454522 24568 raft_consensus.cc:2379] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate a26b1f181f7c4eed8c88556fb8331580 in current term 2: Already voted for candidate 54c1596155894af490c826081bf8562f in this term.
I20260807 19:49:07.454815 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.454185 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60328)
0807 19:49:07.454457 (+ 272us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.454552 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":144}
I20260807 19:49:07.455384 24275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54c1596155894af490c826081bf8562f" candidate_term: 2 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a26b1f181f7c4eed8c88556fb8331580"
I20260807 19:49:07.455689 24275 raft_consensus.cc:2379] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 54c1596155894af490c826081bf8562f in current term 2: Already voted for candidate a26b1f181f7c4eed8c88556fb8331580 in this term.
I20260807 19:49:07.456158 25441 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.455681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60344)
0807 19:49:07.455850 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.455954 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:49:07.456193 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.454905 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60316)
0807 19:49:07.455937 (+ 1032us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.456027 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":919}
W20260807 19:49:07.456514 24529 leader_election.cc:334] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:07.456657 24529 leader_election.cc:302] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 54c1596155894af490c826081bf8562f; no voters: 25e97a7361944c7394809e39705da6d6, a26b1f181f7c4eed8c88556fb8331580
I20260807 19:49:07.456990 25433 raft_consensus.cc:2726] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 19:49:07.457473 25435 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.457150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60352)
0807 19:49:07.457283 (+ 133us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.457366 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":43}
W20260807 19:49:07.457703 24236 leader_election.cc:334] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:07.457876 24236 leader_election.cc:302] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a26b1f181f7c4eed8c88556fb8331580; no voters: 25e97a7361944c7394809e39705da6d6, 54c1596155894af490c826081bf8562f
I20260807 19:49:07.458245 25434 raft_consensus.cc:2726] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20260807 19:49:07.892833 25449 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.891827 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:43459)
0807 19:49:07.892472 (+ 645us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.892592 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":501,"thread_start_us":339,"threads_started":1}
I20260807 19:49:07.897177 25450 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.896088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:38465)
0807 19:49:07.896754 (+ 666us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.896883 (+ 129us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":376,"threads_started":1}
I20260807 19:49:07.904851 25451 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:07.903897 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:41327)
0807 19:49:07.904476 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:07.904583 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":304,"threads_started":1}
I20260807 19:49:08.895361 25453 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:08.894414 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:40095)
0807 19:49:08.895000 (+ 586us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:08.895130 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":289,"threads_started":1}
I20260807 19:49:08.899446 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:08.898441 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:49067)
0807 19:49:08.899068 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:08.899170 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":478,"thread_start_us":355,"threads_started":1}
I20260807 19:49:08.906591 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:08.905729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:35179)
0807 19:49:08.906254 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:08.906370 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":242,"threads_started":1}
I20260807 19:49:09.213940 25460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:09.214344 25460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:09.215273 25460 leader_election.cc:288] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549), a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189:35731)
I20260807 19:49:09.216104 24275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54c1596155894af490c826081bf8562f" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a26b1f181f7c4eed8c88556fb8331580" is_pre_election: true
I20260807 19:49:09.216516 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.215535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60600)
0807 19:49:09.216110 (+ 575us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.216249 (+ 139us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":442,"thread_start_us":306,"threads_started":1}
I20260807 19:49:09.216487 24275 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 54c1596155894af490c826081bf8562f in term 2.
I20260807 19:49:09.217135 24525 leader_election.cc:302] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 54c1596155894af490c826081bf8562f, a26b1f181f7c4eed8c88556fb8331580; no voters:
I20260807 19:49:09.217501 25460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20260807 19:49:09.217797 25460 raft_consensus.cc:482] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:09.217960 25460 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 2 FOLLOWER]: Advancing to term 3
I20260807 19:49:09.218535 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.218103 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60602)
0807 19:49:09.218303 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.218393 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 19:49:09.218848 24529 leader_election.cc:334] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:09.221154 25460 raft_consensus.cc:504] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 3 FOLLOWER]: Starting leader election with config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:09.221786 25460 leader_election.cc:288] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 3 election: Requested vote from peers 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549), a26b1f181f7c4eed8c88556fb8331580 (127.12.155.189:35731)
I20260807 19:49:09.222338 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.221869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60614)
0807 19:49:09.222046 (+ 177us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.222158 (+ 112us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:49:09.222707 24275 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "54c1596155894af490c826081bf8562f" candidate_term: 3 candidate_status { last_received { term: 1 index: 12 } } ignore_live_leader: false dest_uuid: "a26b1f181f7c4eed8c88556fb8331580"
I20260807 19:49:09.223033 24275 raft_consensus.cc:3037] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 2 FOLLOWER]: Advancing to term 3
I20260807 19:49:09.223493 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.223102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60626)
0807 19:49:09.223278 (+ 176us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.223355 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 19:49:09.223676 24529 leader_election.cc:334] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
I20260807 19:49:09.225596 24275 raft_consensus.cc:2454] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 54c1596155894af490c826081bf8562f in term 3.
I20260807 19:49:09.226190 24525 leader_election.cc:302] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 54c1596155894af490c826081bf8562f, a26b1f181f7c4eed8c88556fb8331580; no voters: 25e97a7361944c7394809e39705da6d6
I20260807 19:49:09.226644 25460 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 3 FOLLOWER]: Leader election won for term 3
I20260807 19:49:09.227502 25460 raft_consensus.cc:686] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [term 3 LEADER]: Becoming Leader. State: Replica: 54c1596155894af490c826081bf8562f, State: Running, Role: LEADER
I20260807 19:49:09.227986 25460 consensus_queue.cc:237] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 12, Committed index: 12, Last appended: 1.12, Last appended by leader: 12, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } }
I20260807 19:49:09.230619 25465 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54c1596155894af490c826081bf8562f. Latest consensus state: current_term: 3 leader_uuid: "54c1596155894af490c826081bf8562f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:09.230978 25465 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:09.231935 25467 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:09.236744 25467 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:09.237845 25467 catalog_manager.cc:1259] Loaded cluster ID: 1ca527124c05406588dac8e36701c2f9
I20260807 19:49:09.237972 25467 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:09.239483 25467 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:09.240463 25467 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Loaded TSK: 0
I20260807 19:49:09.241622 25467 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:49:09.315392 24553 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46236:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:49:09.323562 24553 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:09.329205 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.328651 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60660)
0807 19:49:09.328839 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.328973 (+ 134us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 19:49:09.329443 24275 raft_consensus.cc:1261] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [term 3 FOLLOWER]: Refusing update from remote peer 54c1596155894af490c826081bf8562f: Log matching property violated. Preceding OpId in replica: term: 1 index: 12. Preceding OpId from leader: term: 3 index: 14. (index mismatch)
I20260807 19:49:09.330651 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.330176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60666)
0807 19:49:09.330382 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.330471 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 19:49:09.330505 25465 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [LEADER]: Connected to new peer: Peer: permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 13, Last known committed idx: 12, Time since last communication: 0.000s
W20260807 19:49:09.331020 24529 consensus_peers.cc:487] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f -> Peer 25e97a7361944c7394809e39705da6d6 (127.12.155.190:44549): Couldn't send request to peer 25e97a7361944c7394809e39705da6d6. Status: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20260807 19:49:09.334619 25469 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 54c1596155894af490c826081bf8562f. Latest consensus state: current_term: 3 leader_uuid: "54c1596155894af490c826081bf8562f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:09.334975 25469 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:09.336716 25460 sys_catalog.cc:455] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 3 leader_uuid: "54c1596155894af490c826081bf8562f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:09.337167 25460 sys_catalog.cc:458] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:09.338016 25470 mvcc.cc:205] Tried to move back new op lower bound from 7315997283643719680 to 7315997283241861120. Current Snapshot: MvccSnapshot[applied={T|T < 7315997283643719680}]
I20260807 19:49:09.338754 25469 sys_catalog.cc:455] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 3 leader_uuid: "54c1596155894af490c826081bf8562f" committed_config { opid_index: 8 OBSOLETE_local: true peers { permanent_uuid: "25e97a7361944c7394809e39705da6d6" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44549 } } peers { permanent_uuid: "a26b1f181f7c4eed8c88556fb8331580" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35731 } attrs { promote: false } } peers { permanent_uuid: "54c1596155894af490c826081bf8562f" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 38351 } attrs { promote: false } } }
I20260807 19:49:09.339095 25469 sys_catalog.cc:458] T 00000000000000000000000000000000 P a26b1f181f7c4eed8c88556fb8331580 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:49:09.357270 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.349622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:36363 (local address 127.0.0.1:41090)
0807 19:49:09.349801 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.349823 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:09.349964 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:09.351084 (+ 1120us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:09.351092 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:09.351129 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:09.351572 (+ 443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.351585 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.353429 (+ 1844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.353438 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.354908 (+ 1470us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.354923 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.356588 (+ 1665us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.356595 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.356765 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.356799 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:49:09.356861 (+ 62us) client_negotiation.cc:240] Negotiation successful
0807 19:49:09.356981 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":37}
I20260807 19:49:09.358760 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.349847 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41090 (local address 127.12.155.130:36363)
0807 19:49:09.350655 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.350660 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.350678 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:49:09.350788 (+ 110us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.350797 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.350897 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.351947 (+ 1050us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:09.352268 (+ 321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.353278 (+ 1010us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.355090 (+ 1812us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.356345 (+ 1255us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.358055 (+ 1710us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.358189 (+ 134us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.358237 (+ 48us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.358359 (+ 122us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":655,"thread_start_us":843,"threads_started":1}
I20260807 19:49:09.359706 24982 tablet_service.cc:1467] Processing CreateTablet for tablet ff6a031732794f6dbee7098445767ffb (DEFAULT_TABLE table=test-table [id=9ab604b20dbe424088e4a38634d228d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:09.360313 24982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6a031732794f6dbee7098445767ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:09.368503 25486 tablet_bootstrap.cc:492] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Bootstrap starting.
I20260807 19:49:09.369709 25462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.351667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35151 (local address 127.0.0.1:33510)
0807 19:49:09.357703 (+ 6036us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.357724 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:09.357824 (+ 100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:09.362998 (+ 5174us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:09.363008 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:09.363071 (+ 63us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:09.363342 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.363353 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.364883 (+ 1530us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.364892 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.366946 (+ 2054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.366960 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.368833 (+ 1873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.368839 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.369018 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.369069 (+ 51us) client_negotiation.cc:769] Sending connection context
0807 19:49:09.369145 (+ 76us) client_negotiation.cc:240] Negotiation successful
0807 19:49:09.369305 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":5932,"mutex_wait_us":50,"thread_start_us":9581,"threads_started":1}
I20260807 19:49:09.370684 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.352272 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33510 (local address 127.12.155.131:35151)
0807 19:49:09.362581 (+ 10309us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.362588 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.362612 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:49:09.362701 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.362707 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.362790 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.362922 (+ 132us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:09.363519 (+ 597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.364744 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.367157 (+ 2413us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.368634 (+ 1477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.370038 (+ 1404us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.370149 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.370207 (+ 58us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.370382 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10140,"thread_start_us":10003,"threads_started":1}
I20260807 19:49:09.371747 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.350734 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53920 (local address 127.12.155.129:45995)
0807 19:49:09.363587 (+ 12853us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.363595 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.363618 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:49:09.363705 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.363711 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.363797 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.363930 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:09.364607 (+ 677us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.365779 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.368630 (+ 2851us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.370288 (+ 1658us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.370502 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.370598 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.371193 (+ 595us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.371372 (+ 179us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12679,"thread_start_us":12512,"threads_started":1}
I20260807 19:49:09.371764 25479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.350509 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:45995 (local address 127.0.0.1:53920)
0807 19:49:09.351468 (+ 959us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.351488 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:09.351615 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:09.363976 (+ 12361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:09.363984 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:09.364018 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:09.364388 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.364400 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.365936 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.365943 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.368380 (+ 2437us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.368398 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.370739 (+ 2341us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.370745 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.370953 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.370993 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:49:09.371109 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 19:49:09.371298 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":788,"mutex_wait_us":1,"thread_start_us":622,"threads_started":1}
I20260807 19:49:09.371706 25208 tablet_service.cc:1467] Processing CreateTablet for tablet ff6a031732794f6dbee7098445767ffb (DEFAULT_TABLE table=test-table [id=9ab604b20dbe424088e4a38634d228d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:09.372328 25208 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6a031732794f6dbee7098445767ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:09.373104 25486 tablet_bootstrap.cc:654] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:09.373132 24732 tablet_service.cc:1467] Processing CreateTablet for tablet ff6a031732794f6dbee7098445767ffb (DEFAULT_TABLE table=test-table [id=9ab604b20dbe424088e4a38634d228d0]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:09.373783 24732 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet ff6a031732794f6dbee7098445767ffb. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:09.376444 25486 tablet_bootstrap.cc:492] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: No bootstrap required, opened a new log
I20260807 19:49:09.376682 25486 ts_tablet_manager.cc:1397] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Time spent bootstrapping tablet: real 0.008s user 0.005s sys 0.000s
I20260807 19:49:09.377899 25486 raft_consensus.cc:348] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.378325 25486 raft_consensus.cc:374] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:09.378470 25486 raft_consensus.cc:729] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: fc57c251e3044bd79497324d416183d5, State: Initialized, Role: FOLLOWER
I20260807 19:49:09.378878 25486 consensus_queue.cc:260] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.382782 25489 tablet_bootstrap.cc:492] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Bootstrap starting.
I20260807 19:49:09.383368 25491 tablet_bootstrap.cc:492] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Bootstrap starting.
I20260807 19:49:09.385367 25489 tablet_bootstrap.cc:654] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:09.385620 25491 tablet_bootstrap.cc:654] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:09.387050 25486 ts_tablet_manager.cc:1428] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Time spent starting tablet: real 0.010s user 0.006s sys 0.004s
I20260807 19:49:09.388477 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.387900 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:40869)
0807 19:49:09.388134 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.388250 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 19:49:09.390022 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.389319 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:51561)
0807 19:49:09.389646 (+ 327us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.389765 (+ 119us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":175}
I20260807 19:49:09.391381 25080 heartbeater.cc:503] Master 127.12.155.188:38351 was elected leader, sending a full tablet report...
I20260807 19:49:09.394846 25491 tablet_bootstrap.cc:492] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: No bootstrap required, opened a new log
I20260807 19:49:09.394935 25489 tablet_bootstrap.cc:492] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: No bootstrap required, opened a new log
I20260807 19:49:09.395087 25491 ts_tablet_manager.cc:1397] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Time spent bootstrapping tablet: real 0.012s user 0.000s sys 0.008s
I20260807 19:49:09.395181 25489 ts_tablet_manager.cc:1397] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Time spent bootstrapping tablet: real 0.013s user 0.004s sys 0.004s
I20260807 19:49:09.396159 25489 raft_consensus.cc:348] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.396266 25491 raft_consensus.cc:348] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.396466 25489 raft_consensus.cc:374] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:09.396593 25491 raft_consensus.cc:374] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:09.396600 25489 raft_consensus.cc:729] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a9357ed3544e471f8223ce65a096c934, State: Initialized, Role: FOLLOWER
I20260807 19:49:09.396706 25491 raft_consensus.cc:729] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0a968bf47dde475794cf3d231c9ecb58, State: Initialized, Role: FOLLOWER
I20260807 19:49:09.397087 25491 consensus_queue.cc:260] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.397032 25489 consensus_queue.cc:260] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.398280 25491 ts_tablet_manager.cc:1428] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Time spent starting tablet: real 0.003s user 0.004s sys 0.000s
I20260807 19:49:09.398838 25489 ts_tablet_manager.cc:1428] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Time spent starting tablet: real 0.003s user 0.003s sys 0.002s
I20260807 19:49:09.400225 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.399511 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:37275)
0807 19:49:09.399835 (+ 324us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.399981 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":163}
I20260807 19:49:09.402680 24845 heartbeater.cc:503] Master 127.12.155.188:38351 was elected leader, sending a full tablet report...
I20260807 19:49:09.403304 25309 heartbeater.cc:503] Master 127.12.155.188:38351 was elected leader, sending a full tablet report...
I20260807 19:49:09.405550 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.398992 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:48511)
0807 19:49:09.404924 (+ 5932us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.405080 (+ 156us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":5772,"thread_start_us":5503,"threads_started":1}
I20260807 19:49:09.405664 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.405170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:48839)
0807 19:49:09.405325 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.405424 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":39}
I20260807 19:49:09.407523 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.407110 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:43289)
0807 19:49:09.407293 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.407383 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:49:09.464444 25089 tablet.cc:2369] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:09.661185 25495 raft_consensus.cc:482] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:09.661523 25495 raft_consensus.cc:504] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.663506 25495 leader_election.cc:288] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363), a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:09.670851 25485 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.664080 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:36297 (local address 127.12.155.131:35151)
0807 19:49:09.664326 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.664332 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.665010 (+ 678us) server_negotiation.cc:407] Connection header received
0807 19:49:09.665125 (+ 115us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.665129 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.665201 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.665296 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:09.665912 (+ 616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.666775 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.668872 (+ 2097us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.669806 (+ 934us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.670016 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.670134 (+ 118us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.670401 (+ 267us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.670549 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":90}
I20260807 19:49:09.671290 25499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.663878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35151 (local address 127.12.155.129:36297)
0807 19:49:09.664864 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.664881 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:09.665005 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:09.665354 (+ 349us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:09.665358 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:09.665383 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:09.665748 (+ 365us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.665757 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.666918 (+ 1161us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.666926 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.668715 (+ 1789us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.668729 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.670016 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.670022 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.670225 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.670252 (+ 27us) client_negotiation.cc:769] Sending connection context
0807 19:49:09.670361 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 19:49:09.670515 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":845,"mutex_wait_us":184,"thread_start_us":362,"threads_started":1}
I20260807 19:49:09.671480 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.663878 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:36363 (local address 127.12.155.129:39097)
0807 19:49:09.664098 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.664124 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:09.664311 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:09.664919 (+ 608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:09.664927 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:09.664965 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:09.665354 (+ 389us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.665365 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.666815 (+ 1450us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.666825 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.668935 (+ 2110us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:09.668950 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.670565 (+ 1615us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.670573 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:09.670777 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.670805 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 19:49:09.670925 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 19:49:09.671081 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":61,"mutex_wait_us":51}
I20260807 19:49:09.671994 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.664084 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:39097 (local address 127.12.155.130:36363)
0807 19:49:09.664388 (+ 304us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.664398 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.664427 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:49:09.664572 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.664580 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.664680 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.664857 (+ 177us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:09.665599 (+ 742us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.666679 (+ 1080us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.669109 (+ 2430us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.670309 (+ 1200us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.670525 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.670617 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.670972 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.671127 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260807 19:49:09.672242 25247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6a031732794f6dbee7098445767ffb" candidate_uuid: "0a968bf47dde475794cf3d231c9ecb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9357ed3544e471f8223ce65a096c934" is_pre_election: true
I20260807 19:49:09.672564 25247 raft_consensus.cc:2454] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a968bf47dde475794cf3d231c9ecb58 in term 0.
I20260807 19:49:09.673230 24651 leader_election.cc:302] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a968bf47dde475794cf3d231c9ecb58, a9357ed3544e471f8223ce65a096c934; no voters:
I20260807 19:49:09.673097 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6a031732794f6dbee7098445767ffb" candidate_uuid: "0a968bf47dde475794cf3d231c9ecb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc57c251e3044bd79497324d416183d5" is_pre_election: true
I20260807 19:49:09.673677 25015 raft_consensus.cc:2454] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0a968bf47dde475794cf3d231c9ecb58 in term 0.
I20260807 19:49:09.673725 25495 raft_consensus.cc:2781] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:09.673909 25495 raft_consensus.cc:482] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:09.674052 25495 raft_consensus.cc:3037] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:09.676909 25495 raft_consensus.cc:504] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.677700 25495 leader_election.cc:288] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [CANDIDATE]: Term 1 election: Requested vote from peers fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363), a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151)
I20260807 19:49:09.678260 25015 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6a031732794f6dbee7098445767ffb" candidate_uuid: "0a968bf47dde475794cf3d231c9ecb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "fc57c251e3044bd79497324d416183d5"
I20260807 19:49:09.678494 25015 raft_consensus.cc:3037] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:09.678521 25247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ff6a031732794f6dbee7098445767ffb" candidate_uuid: "0a968bf47dde475794cf3d231c9ecb58" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a9357ed3544e471f8223ce65a096c934"
I20260807 19:49:09.678838 25247 raft_consensus.cc:3037] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:09.681047 25015 raft_consensus.cc:2454] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a968bf47dde475794cf3d231c9ecb58 in term 1.
I20260807 19:49:09.681424 25247 raft_consensus.cc:2454] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0a968bf47dde475794cf3d231c9ecb58 in term 1.
I20260807 19:49:09.681557 24650 leader_election.cc:302] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0a968bf47dde475794cf3d231c9ecb58, fc57c251e3044bd79497324d416183d5; no voters:
I20260807 19:49:09.681932 25495 raft_consensus.cc:2781] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:09.682528 25495 raft_consensus.cc:686] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 1 LEADER]: Becoming Leader. State: Replica: 0a968bf47dde475794cf3d231c9ecb58, State: Running, Role: LEADER
I20260807 19:49:09.683194 25495 consensus_queue.cc:237] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } }
I20260807 19:49:09.683806 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.683323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:40627)
0807 19:49:09.683515 (+ 192us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.683652 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 19:49:09.688176 24553 catalog_manager.cc:5495] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 reported cstate change: term changed from 0 to 1, leader changed from <none> to 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "0a968bf47dde475794cf3d231c9ecb58" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0a968bf47dde475794cf3d231c9ecb58" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 45995 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 } health_report { overall_health: UNKNOWN } } }
I20260807 19:49:09.744747 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.738639 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53928 (local address 127.12.155.129:45995)
0807 19:49:09.738888 (+ 249us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.738894 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.738940 (+ 46us) server_negotiation.cc:407] Connection header received
0807 19:49:09.739082 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.739086 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.739194 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.739374 (+ 180us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:09.739795 (+ 421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.740576 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.742118 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.742637 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.742828 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.743291 (+ 463us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:09.744053 (+ 762us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:09.744231 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.744314 (+ 83us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.744410 (+ 96us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 19:49:09.750200 25247 raft_consensus.cc:1261] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Refusing update from remote peer 0a968bf47dde475794cf3d231c9ecb58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:09.750710 25015 raft_consensus.cc:1261] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Refusing update from remote peer 0a968bf47dde475794cf3d231c9ecb58: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:09.751149 25500 consensus_queue.cc:1035] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a9357ed3544e471f8223ce65a096c934" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35151 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:09.751662 25495 consensus_queue.cc:1035] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [LEADER]: Connected to new peer: Peer: permanent_uuid: "fc57c251e3044bd79497324d416183d5" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 36363 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:09.755226 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.754692 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:35569)
0807 19:49:09.754889 (+ 197us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.755011 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
I20260807 19:49:09.761426 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.760888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:54123)
0807 19:49:09.761093 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.761211 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 19:49:09.762836 25456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.762309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.130:43317)
0807 19:49:09.762541 (+ 232us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.762647 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":121}
I20260807 19:49:09.763588 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.763073 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:59917)
0807 19:49:09.763283 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.763390 (+ 107us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:49:09.766956 25506 mvcc.cc:205] Tried to move back new op lower bound from 7315997285367472128 to 7315997285108228096. Current Snapshot: MvccSnapshot[applied={T|T < 7315997285367472128 or (T in {7315997285367472128})}]
I20260807 19:49:09.768476 25497 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.767986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.129:49115)
0807 19:49:09.768208 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.768299 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":111}
I20260807 19:49:09.770774 25454 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.770163 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.12.155.131:33769)
0807 19:49:09.770455 (+ 292us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.770570 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":130}
I20260807 19:49:09.781057 24553 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:09.781466 24553 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:46236:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:09.793717 24553 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 54c1596155894af490c826081bf8562f: Sending DeleteTablet for 3 replicas of tablet ff6a031732794f6dbee7098445767ffb
I20260807 19:49:09.795143 24732 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6a031732794f6dbee7098445767ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:09 UTC) from {username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:53920
I20260807 19:49:09.795884 25208 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6a031732794f6dbee7098445767ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:09 UTC) from {username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:33510
I20260807 19:49:09.796370 25207 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6a031732794f6dbee7098445767ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:09 UTC) from {username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:33510
I20260807 19:49:09.798034 24982 tablet_service.cc:1514] Processing DeleteTablet for tablet ff6a031732794f6dbee7098445767ffb with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:09 UTC) from {username='oryx', principal='oryx/127.12.155.188@KRBTEST.COM'} at 127.0.0.1:41090
I20260807 19:49:09.798281 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 24509
I20260807 19:49:09.801868 25526 tablet_replica.cc:330] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: stopping tablet replica
I20260807 19:49:09.802277 25526 raft_consensus.cc:2229] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:09.802836 25526 raft_consensus.cc:2258] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:09.804438 25526 ts_tablet_manager.cc:1905] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:09.814558 25526 ts_tablet_manager.cc:1918] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:09.814868 25526 log.cc:1196] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/ff6a031732794f6dbee7098445767ffb
I20260807 19:49:09.815613 25526 ts_tablet_manager.cc:1939] T ff6a031732794f6dbee7098445767ffb P fc57c251e3044bd79497324d416183d5: Deleting consensus metadata
I20260807 19:49:09.817588 24525 catalog_manager.cc:4841] TS fc57c251e3044bd79497324d416183d5 (127.12.155.130:36363): tablet ff6a031732794f6dbee7098445767ffb (table test-table [id=9ab604b20dbe424088e4a38634d228d0]) successfully deleted
I20260807 19:49:09.820817 25523 tablet_replica.cc:330] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: stopping tablet replica
I20260807 19:49:09.821095 25523 raft_consensus.cc:2229] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:09.821596 25523 raft_consensus.cc:2258] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:09.823248 25523 ts_tablet_manager.cc:1905] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:09.830112 25522 tablet_replica.cc:330] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: stopping tablet replica
I20260807 19:49:09.830418 25522 raft_consensus.cc:2229] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:09.831523 25522 raft_consensus.cc:2258] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:09.833057 25522 ts_tablet_manager.cc:1905] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:09.833455 25523 ts_tablet_manager.cc:1918] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:09.833609 25523 log.cc:1196] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/ff6a031732794f6dbee7098445767ffb
I20260807 19:49:09.834198 25523 ts_tablet_manager.cc:1939] T ff6a031732794f6dbee7098445767ffb P a9357ed3544e471f8223ce65a096c934: Deleting consensus metadata
I20260807 19:49:09.836290 24527 catalog_manager.cc:4841] TS a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151): tablet ff6a031732794f6dbee7098445767ffb (table test-table [id=9ab604b20dbe424088e4a38634d228d0]) successfully deleted
W20260807 19:49:09.837713 24527 catalog_manager.cc:4808] TS a9357ed3544e471f8223ce65a096c934 (127.12.155.131:35151): delete failed for tablet ff6a031732794f6dbee7098445767ffb because the tablet was not found. No further retry: Not found: Tablet not found: ff6a031732794f6dbee7098445767ffb
I20260807 19:49:09.841675 25522 ts_tablet_manager.cc:1918] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:09.841885 25522 log.cc:1196] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipalMultipleMaster.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/ff6a031732794f6dbee7098445767ffb
I20260807 19:49:09.842523 25522 ts_tablet_manager.cc:1939] T ff6a031732794f6dbee7098445767ffb P 0a968bf47dde475794cf3d231c9ecb58: Deleting consensus metadata
I20260807 19:49:09.842998 25481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.799663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53942 (local address 127.12.155.129:45995)
0807 19:49:09.799923 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:09.799930 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:09.819707 (+ 19777us) server_negotiation.cc:407] Connection header received
0807 19:49:09.820065 (+ 358us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:09.820072 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:09.820184 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:09.820341 (+ 157us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:09.823173 (+ 2832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.824524 (+ 1351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.826672 (+ 2148us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:09.827430 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:09.827547 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:09.832642 (+ 5095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:09.832667 (+ 25us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:09.832695 (+ 28us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:09.832744 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:09.838520 (+ 5776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:09.839632 (+ 1112us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:09.839643 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:09.839648 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:09.839879 (+ 231us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:09.840443 (+ 564us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:09.840453 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:09.840457 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:09.841073 (+ 616us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:09.841426 (+ 353us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:09.842234 (+ 808us) server_negotiation.cc:299] Negotiation successful
0807 19:49:09.842534 (+ 300us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:49:09.844002 24527 catalog_manager.cc:4841] TS 0a968bf47dde475794cf3d231c9ecb58 (127.12.155.129:45995): tablet ff6a031732794f6dbee7098445767ffb (table test-table [id=9ab604b20dbe424088e4a38634d228d0]) successfully deleted
I20260807 19:49:09.845091 24835 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:09.916669 25532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.915642 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60674)
0807 19:49:09.916334 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.916450 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":562,"thread_start_us":404,"threads_started":1}
I20260807 19:49:09.918305 25532 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:09.917828 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60686)
0807 19:49:09.918009 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:09.918161 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:49:09.969138 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 24509
I20260807 19:49:10.003572 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 24864
I20260807 19:49:10.019959 25478 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:10.004496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41102 (local address 127.12.155.130:36363)
0807 19:49:10.004696 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:10.004702 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:10.004796 (+ 94us) server_negotiation.cc:407] Connection header received
0807 19:49:10.005060 (+ 264us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:10.005065 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:10.005168 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:10.005269 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:10.006981 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:10.007867 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:10.009245 (+ 1378us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:10.009684 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:10.009781 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:10.012729 (+ 2948us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:10.012749 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:10.012773 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:10.012809 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:10.016291 (+ 3482us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:10.017154 (+ 863us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:10.017163 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:10.017166 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:10.017313 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:10.017825 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:10.017831 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:10.017836 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:10.018457 (+ 621us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:10.018891 (+ 434us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:10.019305 (+ 414us) server_negotiation.cc:299] Negotiation successful
0807 19:49:10.019566 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:49:10.020769 25073 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:10.160393 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 24864
I20260807 19:49:10.203027 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 25103
I20260807 19:49:10.219714 25537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:10.204109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33514 (local address 127.12.155.131:35151)
0807 19:49:10.204666 (+ 557us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:10.204672 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:10.204691 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:49:10.204764 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:10.204769 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:10.204842 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:10.204965 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:10.206831 (+ 1866us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:10.207853 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:10.209273 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:10.209738 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:10.209832 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:10.212976 (+ 3144us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:10.212997 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:10.213023 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:10.213062 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:10.216591 (+ 3529us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:10.217444 (+ 853us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:10.217452 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:10.217455 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:10.217602 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:10.217978 (+ 376us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:10.217981 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:10.217984 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:10.218515 (+ 531us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:10.218807 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:10.219189 (+ 382us) server_negotiation.cc:299] Negotiation successful
0807 19:49:10.219385 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":437,"thread_start_us":315,"threads_started":1}
I20260807 19:49:10.220517 25304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:10.329099 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 25103
I20260807 19:49:10.362824 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 24035
I20260807 19:49:10.364463 24305 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:10.492287 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:10.491189 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60690)
0807 19:49:10.491891 (+ 702us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:10.492035 (+ 144us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":539,"thread_start_us":401,"threads_started":1}
I20260807 19:49:10.494117 25541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:10.493576 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:44549 (local address 127.0.0.1:60696)
0807 19:49:10.493777 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:10.493881 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:44549: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 19:49:10.505199 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 24035
I20260807 19:49:10.549490 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 24217
I20260807 19:49:10.551154 24590 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:10.700155 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 24217
2026-08-07T19:49:10Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipalMultipleMaster (13861 ms)
[ RUN ] SecurityITest.TestNonDefaultPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:49:10 dist-test-slave-2p8l krb5kdc[25552](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:49:10 dist-test-slave-2p8l krb5kdc[25552](info): set up 2 sockets
Aug 07 19:49:10 dist-test-slave-2p8l krb5kdc[25552](info): commencing operation
krb5kdc: starting...
W20260807 19:49:12.201081 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.437s user 0.006s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:49:12 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:49:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:12Z Disabled control of system clock
WARNING: no policy specified for oryx/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab.
Entry for principal oryx/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab.
I20260807 19:49:12.538990 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:35507
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab
--principal=oryx/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:35507
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--txn_manager_enabled=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:12.970160 25576 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:12.970597 25576 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:12.970810 25576 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:12.979321 25576 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:12.979490 25576 flags.cc:425] Enabled experimental flag: --txn_manager_enabled=true
W20260807 19:49:12.979537 25576 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:12.979683 25576 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:12.979801 25576 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:12.979929 25576 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:12.991705 25576 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:35507
--txn_manager_enabled=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.190.keytab
--principal=oryx/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:35507
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:12.993968 25576 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:12.996290 25576 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:13.011885 25587 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:13.011940 25588 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:13.012764 25591 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:13.012698 25576 server_base.cc:1034] running on GCE node
I20260807 19:49:13.013814 25576 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:13.015794 25576 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:13.017119 25576 hybrid_clock.cc:648] HybridClock initialized: now 1786132153017007 us; error 46 us; skew 500 ppm
I20260807 19:49:13.017560 25576 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:13 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132153, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:13.025519 25576 init.cc:377] Logged in from keytab as oryx/127.12.155.190@KRBTEST.COM (short username oryx)
I20260807 19:49:13.027431 25576 webserver.cc:460] Webserver started at http://127.12.155.190:36507/ using document root <none> and password file <none>
I20260807 19:49:13.028365 25576 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:13.028470 25576 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:13.028859 25576 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:13.032866 25576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "e5ee318ef3314c34a978d5b139929406"
format_stamp: "Formatted at 2026-08-07 19:49:13 on dist-test-slave-2p8l"
server_key: "38e55a47fab232d9e457328c08512f9a"
server_key_iv: "ca476b49b333e25ac10da309e469c198"
server_key_version: "encryptionkey@0"
I20260807 19:49:13.033828 25576 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "e5ee318ef3314c34a978d5b139929406"
format_stamp: "Formatted at 2026-08-07 19:49:13 on dist-test-slave-2p8l"
server_key: "38e55a47fab232d9e457328c08512f9a"
server_key_iv: "ca476b49b333e25ac10da309e469c198"
server_key_version: "encryptionkey@0"
I20260807 19:49:13.040654 25576 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.003s
I20260807 19:49:13.045502 25599 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:13.047541 25576 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.002s
I20260807 19:49:13.047770 25576 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "e5ee318ef3314c34a978d5b139929406"
format_stamp: "Formatted at 2026-08-07 19:49:13 on dist-test-slave-2p8l"
server_key: "38e55a47fab232d9e457328c08512f9a"
server_key_iv: "ca476b49b333e25ac10da309e469c198"
server_key_version: "encryptionkey@0"
I20260807 19:49:13.048074 25576 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:13.062412 25576 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:13.067867 25576 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:13.068213 25576 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:13.094719 25576 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:35507
I20260807 19:49:13.094756 25698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:35507 every 8 connection(s)
I20260807 19:49:13.096550 25576 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:49:13.101557 25699 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:13.106457 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 25576
I20260807 19:49:13.106745 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:49:13.107517 12910 external_mini_cluster.cc:1428] Setting key 12cf706dd09818f3ce7d18a6227b05b0
I20260807 19:49:13.116751 25699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Bootstrap starting.
I20260807 19:49:13.121788 25699 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:13.123596 25699 log.cc:824] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:49:13 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132152, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:13.128100 25699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: No bootstrap required, opened a new log
I20260807 19:49:13.139495 25703 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:13.110232 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54700 (local address 127.12.155.190:35507)
0807 19:49:13.111261 (+ 1029us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:13.111287 (+ 26us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:13.111355 (+ 68us) server_negotiation.cc:407] Connection header received
0807 19:49:13.114342 (+ 2987us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:13.114387 (+ 45us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:13.115110 (+ 723us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:13.115687 (+ 577us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:13.117521 (+ 1834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.119808 (+ 2287us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.121609 (+ 1801us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.122930 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.123185 (+ 255us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:13.128578 (+ 5393us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:13.128592 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:13.128617 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:13.128675 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:13.133367 (+ 4692us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:13.134368 (+ 1001us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:13.134379 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:13.134390 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:13.134685 (+ 295us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:13.135127 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:13.135133 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:13.135137 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:13.136096 (+ 959us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:13.136461 (+ 365us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:13.136942 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 19:49:13.137550 (+ 608us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":725,"thread_start_us":445,"threads_started":1}
I20260807 19:49:13.140731 25699 raft_consensus.cc:348] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ee318ef3314c34a978d5b139929406" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35507 } }
I20260807 19:49:13.141338 25699 raft_consensus.cc:374] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:13.141494 25699 raft_consensus.cc:729] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e5ee318ef3314c34a978d5b139929406, State: Initialized, Role: FOLLOWER
I20260807 19:49:13.142334 25699 consensus_queue.cc:260] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ee318ef3314c34a978d5b139929406" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35507 } }
I20260807 19:49:13.142660 25699 raft_consensus.cc:388] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:49:13.142815 25699 raft_consensus.cc:482] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:49:13.143042 25699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:13.146037 25699 raft_consensus.cc:504] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ee318ef3314c34a978d5b139929406" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35507 } }
I20260807 19:49:13.146754 25699 leader_election.cc:302] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e5ee318ef3314c34a978d5b139929406; no voters:
I20260807 19:49:13.147449 25699 leader_election.cc:288] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:49:13.147634 25706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:13.148480 25706 raft_consensus.cc:686] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [term 1 LEADER]: Becoming Leader. State: Replica: e5ee318ef3314c34a978d5b139929406, State: Running, Role: LEADER
I20260807 19:49:13.149118 25706 consensus_queue.cc:237] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ee318ef3314c34a978d5b139929406" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35507 } }
I20260807 19:49:13.150144 25699 sys_catalog.cc:564] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:13.152539 25708 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e5ee318ef3314c34a978d5b139929406. Latest consensus state: current_term: 1 leader_uuid: "e5ee318ef3314c34a978d5b139929406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ee318ef3314c34a978d5b139929406" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35507 } } }
I20260807 19:49:13.153028 25708 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:13.153903 25707 sys_catalog.cc:455] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e5ee318ef3314c34a978d5b139929406" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e5ee318ef3314c34a978d5b139929406" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35507 } } }
I20260807 19:49:13.154285 25707 sys_catalog.cc:458] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:13.161397 25715 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:13.168268 25715 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:13.179282 25715 catalog_manager.cc:1347] Generated new cluster ID: 503657338aff484c8e16b047469dea07
I20260807 19:49:13.179447 25715 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:13.218317 25715 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:49:13.220054 25715 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:13.234505 25715 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Generated new TSK 0
I20260807 19:49:13.235790 25715 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for oryx/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab.
Entry for principal oryx/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab.
I20260807 19:49:13.314694 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35507
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:13.737723 25734 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:13.738225 25734 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:13.738428 25734 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:13.746953 25734 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:13.747189 25734 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:13.747346 25734 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:49:13.747500 25734 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:13.759510 25734 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:35507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:13.761626 25734 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:13.764015 25734 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:13.780229 25741 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:13.780260 25744 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:13.781102 25740 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:13.781714 25734 server_base.cc:1034] running on GCE node
I20260807 19:49:13.782616 25734 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:13.783811 25734 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:13.785064 25734 hybrid_clock.cc:648] HybridClock initialized: now 1786132153784979 us; error 51 us; skew 500 ppm
I20260807 19:49:13.785472 25734 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:13 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132153, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:13.789518 25734 init.cc:377] Logged in from keytab as oryx/127.12.155.129@KRBTEST.COM (short username oryx)
I20260807 19:49:13.791502 25734 webserver.cc:460] Webserver started at http://127.12.155.129:38969/ using document root <none> and password file <none>
I20260807 19:49:13.792527 25734 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:13.792666 25734 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:13.793100 25734 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:13.796885 25734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "5b5bb5247a4249ee9527f4cfa23c4e49"
format_stamp: "Formatted at 2026-08-07 19:49:13 on dist-test-slave-2p8l"
server_key: "d6b4aa235a906c2be10db99b6a3c3729"
server_key_iv: "ca31aaa5643accc2dfd8d7d60d72bde0"
server_key_version: "encryptionkey@0"
I20260807 19:49:13.797880 25734 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "5b5bb5247a4249ee9527f4cfa23c4e49"
format_stamp: "Formatted at 2026-08-07 19:49:13 on dist-test-slave-2p8l"
server_key: "d6b4aa235a906c2be10db99b6a3c3729"
server_key_iv: "ca31aaa5643accc2dfd8d7d60d72bde0"
server_key_version: "encryptionkey@0"
I20260807 19:49:13.804054 25734 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.000s
I20260807 19:49:13.808286 25757 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:13.809824 25734 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:49:13.810024 25734 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "5b5bb5247a4249ee9527f4cfa23c4e49"
format_stamp: "Formatted at 2026-08-07 19:49:13 on dist-test-slave-2p8l"
server_key: "d6b4aa235a906c2be10db99b6a3c3729"
server_key_iv: "ca31aaa5643accc2dfd8d7d60d72bde0"
server_key_version: "encryptionkey@0"
I20260807 19:49:13.810334 25734 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:13.832510 25734 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:13.837988 25734 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:13.838382 25734 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:13.841908 25734 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:13.842041 25734 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:13.842219 25734 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:13.842316 25734 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:49:13 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132153, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:13.868899 25772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:13.842546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:52979 (local address 127.12.155.190:35507)
0807 19:49:13.843799 (+ 1253us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:13.843804 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:13.844627 (+ 823us) server_negotiation.cc:407] Connection header received
0807 19:49:13.847046 (+ 2419us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:13.847053 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:13.847172 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:13.847312 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:13.850112 (+ 2800us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.851335 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.854205 (+ 2870us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.854811 (+ 606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.854987 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:13.860719 (+ 5732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:13.860726 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:13.860730 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:13.860776 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:13.864541 (+ 3765us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:13.865453 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:13.865464 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:13.865467 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:13.865618 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:13.866183 (+ 565us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:13.866187 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:13.866189 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:13.866610 (+ 421us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:13.866803 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:13.868219 (+ 1416us) server_negotiation.cc:299] Negotiation successful
0807 19:49:13.868570 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1116,"thread_start_us":1002,"threads_started":1}
I20260807 19:49:13.871603 25773 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:13.843415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.12.155.129:52979)
0807 19:49:13.844410 (+ 995us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:13.844472 (+ 62us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:13.846679 (+ 2207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:13.847624 (+ 945us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:13.847634 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:13.848553 (+ 919us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:13.849752 (+ 1199us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:13.849791 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.851535 (+ 1744us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.851553 (+ 18us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:13.853999 (+ 2446us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:13.854013 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.855425 (+ 1412us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.855440 (+ 15us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:13.855741 (+ 301us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:13.856690 (+ 949us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:13.856748 (+ 58us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:13.860405 (+ 3657us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:13.864726 (+ 4321us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:13.864746 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:13.864766 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:13.865289 (+ 523us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:13.865746 (+ 457us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:13.865751 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:13.865755 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:13.866000 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:13.866811 (+ 811us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:13.866826 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:13.867593 (+ 767us) client_negotiation.cc:769] Sending connection context
0807 19:49:13.868070 (+ 477us) client_negotiation.cc:240] Negotiation successful
0807 19:49:13.868982 (+ 912us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":704,"thread_start_us":449,"threads_started":1}
I20260807 19:49:13.895252 25772 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:13.880982 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:60145 (local address 127.12.155.190:35507)
0807 19:49:13.881267 (+ 285us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:13.881277 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:13.881337 (+ 60us) server_negotiation.cc:407] Connection header received
0807 19:49:13.881572 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:13.881581 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:13.881709 (+ 128us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:13.881849 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:13.883228 (+ 1379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.884141 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.885527 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.885988 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.886180 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:13.889107 (+ 2927us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:13.889112 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:13.889116 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:13.889154 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:13.892211 (+ 3057us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:13.892979 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:13.892989 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:13.892991 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:13.893141 (+ 150us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:13.893531 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:13.893538 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:13.893541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:13.893885 (+ 344us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:13.894072 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:13.894543 (+ 471us) server_negotiation.cc:299] Negotiation successful
0807 19:49:13.894834 (+ 291us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:49:13.895512 25881 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:13.880445 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.12.155.129:60145)
0807 19:49:13.881211 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:13.881245 (+ 34us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:13.881407 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:13.881861 (+ 454us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:13.881864 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:13.882480 (+ 616us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:13.883062 (+ 582us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:13.883074 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.884285 (+ 1211us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.884291 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:13.885377 (+ 1086us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:13.885390 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:13.886237 (+ 847us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:13.886244 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:13.886443 (+ 199us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:13.887419 (+ 976us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:13.887439 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:13.888797 (+ 1358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:13.892361 (+ 3564us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:13.892367 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:13.892371 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:13.892817 (+ 446us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:13.893262 (+ 445us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:13.893267 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:13.893271 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:13.893415 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:13.894014 (+ 599us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:13.894042 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:13.894272 (+ 230us) client_negotiation.cc:769] Sending connection context
0807 19:49:13.894445 (+ 173us) client_negotiation.cc:240] Negotiation successful
0807 19:49:13.894908 (+ 463us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":570,"thread_start_us":605,"threads_started":1}
I20260807 19:49:13.908215 25734 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:39547
I20260807 19:49:13.908228 25955 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:39547 every 8 connection(s)
I20260807 19:49:13.910281 25734 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:13.912880 25958 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35507
I20260807 19:49:13.913172 25958 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:13.914089 25958 heartbeater.cc:511] Master 127.12.155.190:35507 requested a full tablet report, sending...
I20260807 19:49:13.915184 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 25734
I20260807 19:49:13.915488 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:49:13.916549 12910 external_mini_cluster.cc:1428] Setting key fc9e800970ba4601cb2793b140161d03
I20260807 19:49:13.917114 25624 ts_manager.cc:194] Registered new tserver with Master: 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547)
I20260807 19:49:13.919525 25624 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:52979
WARNING: no policy specified for oryx/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab.
Entry for principal oryx/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab.
I20260807 19:49:13.989454 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35507
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:14.404445 25962 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:14.404852 25962 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:14.405047 25962 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:14.413395 25962 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:14.413578 25962 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:14.413753 25962 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:49:14.413899 25962 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:14.425580 25962 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:35507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:14.427639 25962 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:14.429564 25962 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:14.445668 25971 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:14.445706 25969 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:14.445827 25968 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:14.446545 25962 server_base.cc:1034] running on GCE node
I20260807 19:49:14.447368 25962 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:14.448601 25962 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:14.449882 25962 hybrid_clock.cc:648] HybridClock initialized: now 1786132154449807 us; error 53 us; skew 500 ppm
I20260807 19:49:14.450328 25962 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:14 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132154, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:14.454761 25962 init.cc:377] Logged in from keytab as oryx/127.12.155.130@KRBTEST.COM (short username oryx)
I20260807 19:49:14.456656 25962 webserver.cc:460] Webserver started at http://127.12.155.130:38033/ using document root <none> and password file <none>
I20260807 19:49:14.457594 25962 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:14.457744 25962 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:14.458210 25962 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:14.461948 25962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "91ec4ee4b7c44707982aff8916776231"
format_stamp: "Formatted at 2026-08-07 19:49:14 on dist-test-slave-2p8l"
server_key: "ed54825f2c79989255565fe87477bd13"
server_key_iv: "11a09c6d7597df88d028771b4b6cc5d6"
server_key_version: "encryptionkey@0"
I20260807 19:49:14.462960 25962 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "91ec4ee4b7c44707982aff8916776231"
format_stamp: "Formatted at 2026-08-07 19:49:14 on dist-test-slave-2p8l"
server_key: "ed54825f2c79989255565fe87477bd13"
server_key_iv: "11a09c6d7597df88d028771b4b6cc5d6"
server_key_version: "encryptionkey@0"
I20260807 19:49:14.469504 25962 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:49:14.474002 25983 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:14.475978 25962 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:49:14.476187 25962 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "91ec4ee4b7c44707982aff8916776231"
format_stamp: "Formatted at 2026-08-07 19:49:14 on dist-test-slave-2p8l"
server_key: "ed54825f2c79989255565fe87477bd13"
server_key_iv: "11a09c6d7597df88d028771b4b6cc5d6"
server_key_version: "encryptionkey@0"
I20260807 19:49:14.476454 25962 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:14.491091 25962 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:14.496598 25962 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:14.496975 25962 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:14.500581 25962 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:14.500707 25962 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:14.500874 25962 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:14.500975 25962 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:49:14 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132154, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:14.533025 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:14.501498 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:44283 (local address 127.12.155.190:35507)
0807 19:49:14.504836 (+ 3338us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:14.504846 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:14.504882 (+ 36us) server_negotiation.cc:407] Connection header received
0807 19:49:14.506806 (+ 1924us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:14.506814 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:14.506974 (+ 160us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:14.507171 (+ 197us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:14.510867 (+ 3696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.512072 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.515785 (+ 3713us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.516510 (+ 725us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.516683 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:14.523210 (+ 6527us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:14.523217 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:14.523221 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:14.523269 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:14.527529 (+ 4260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:14.529136 (+ 1607us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:14.529146 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:14.529152 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:14.529404 (+ 252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:14.530259 (+ 855us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:14.530268 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:14.530273 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:14.530680 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:14.531009 (+ 329us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:14.532382 (+ 1373us) server_negotiation.cc:299] Negotiation successful
0807 19:49:14.532627 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3158,"thread_start_us":2995,"threads_started":1}
I20260807 19:49:14.535703 26003 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:14.502389 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.12.155.130:44283)
0807 19:49:14.503777 (+ 1388us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:14.503871 (+ 94us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:14.506384 (+ 2513us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:14.507673 (+ 1289us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:14.507693 (+ 20us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:14.508958 (+ 1265us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:14.510444 (+ 1486us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:14.510490 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.512316 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.512324 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:14.515538 (+ 3214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:14.515562 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.516862 (+ 1300us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.516875 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:14.517184 (+ 309us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:14.518434 (+ 1250us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:14.518481 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:14.522809 (+ 4328us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:14.527797 (+ 4988us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:14.527818 (+ 21us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:14.527853 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:14.528901 (+ 1048us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:14.529578 (+ 677us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:14.529586 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:14.529597 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:14.530047 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:14.530971 (+ 924us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:14.530986 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:14.531793 (+ 807us) client_negotiation.cc:769] Sending connection context
0807 19:49:14.532263 (+ 470us) client_negotiation.cc:240] Negotiation successful
0807 19:49:14.533202 (+ 939us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":861,"thread_start_us":502,"threads_started":1}
I20260807 19:49:14.560395 25962 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:35257
I20260807 19:49:14.560422 26169 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:35257 every 8 connection(s)
I20260807 19:49:14.562552 25962 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:14.562728 26001 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:14.543992 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:34201 (local address 127.12.155.190:35507)
0807 19:49:14.544276 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:14.544281 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:14.545223 (+ 942us) server_negotiation.cc:407] Connection header received
0807 19:49:14.545507 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:14.545512 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:14.545601 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:14.545729 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:14.547298 (+ 1569us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.548156 (+ 858us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.550688 (+ 2532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.551483 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.551712 (+ 229us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:14.554987 (+ 3275us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:14.554992 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:14.554996 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:14.555042 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:14.558851 (+ 3809us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:14.559880 (+ 1029us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:14.559886 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:14.559892 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:14.560084 (+ 192us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:14.560663 (+ 579us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:14.560668 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:14.560672 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:14.561227 (+ 555us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:14.561428 (+ 201us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:14.561970 (+ 542us) server_negotiation.cc:299] Negotiation successful
0807 19:49:14.562290 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":101}
I20260807 19:49:14.562747 26125 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:14.544106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.12.155.130:34201)
0807 19:49:14.545072 (+ 966us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:14.545092 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:14.545339 (+ 247us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:14.545765 (+ 426us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:14.545770 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:14.546471 (+ 701us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:14.547095 (+ 624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:14.547112 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.548339 (+ 1227us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.548345 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:14.550406 (+ 2061us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:14.550437 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:14.552112 (+ 1675us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:14.552120 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:14.552395 (+ 275us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:14.553435 (+ 1040us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:14.553466 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:14.554623 (+ 1157us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:14.559032 (+ 4409us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:14.559043 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:14.559046 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:14.559723 (+ 677us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:14.560246 (+ 523us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:14.560251 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:14.560255 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:14.560485 (+ 230us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:14.561377 (+ 892us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:14.561381 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:14.561624 (+ 243us) client_negotiation.cc:769] Sending connection context
0807 19:49:14.561788 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 19:49:14.562177 (+ 389us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":796,"thread_start_us":618,"threads_started":1}
I20260807 19:49:14.565296 26170 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35507
I20260807 19:49:14.565613 26170 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:14.566352 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 25962
I20260807 19:49:14.566577 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:49:14.567168 26170 heartbeater.cc:511] Master 127.12.155.190:35507 requested a full tablet report, sending...
I20260807 19:49:14.567229 12910 external_mini_cluster.cc:1428] Setting key c77ea8750653b2b87f7c75c25e5d9739
I20260807 19:49:14.568965 25623 ts_manager.cc:194] Registered new tserver with Master: 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257)
I20260807 19:49:14.570187 25623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:44283
WARNING: no policy specified for oryx/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab.
Entry for principal oryx/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab.
I20260807 19:49:14.640264 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35507
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--enable_txn_system_client_init=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:14.923213 25958 heartbeater.cc:503] Master 127.12.155.190:35507 was elected leader, sending a full tablet report...
W20260807 19:49:15.083060 26176 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:15.083473 26176 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:15.083654 26176 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:15.091897 26176 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:15.092046 26176 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:15.092228 26176 flags.cc:425] Enabled experimental flag: --enable_txn_system_client_init=true
W20260807 19:49:15.092383 26176 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:15.103876 26176 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--enable_txn_system_client_init=true
--tserver_master_addrs=127.12.155.190:35507
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:15.105795 26176 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:15.107717 26176 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:15.124003 26185 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:15.124094 26189 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:15.124178 26182 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:15.125545 26176 server_base.cc:1034] running on GCE node
I20260807 19:49:15.126492 26176 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:15.127794 26176 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:15.129096 26176 hybrid_clock.cc:648] HybridClock initialized: now 1786132155128975 us; error 87 us; skew 500 ppm
I20260807 19:49:15.129513 26176 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:15 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132155, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:15.133430 26176 init.cc:377] Logged in from keytab as oryx/127.12.155.131@KRBTEST.COM (short username oryx)
I20260807 19:49:15.135365 26176 webserver.cc:460] Webserver started at http://127.12.155.131:39723/ using document root <none> and password file <none>
I20260807 19:49:15.136273 26176 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:15.136375 26176 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:15.136729 26176 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:15.140653 26176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "d3db2a840c3a4641838d66810194ad5b"
format_stamp: "Formatted at 2026-08-07 19:49:15 on dist-test-slave-2p8l"
server_key: "f476123df24b91b1db474da43be5cadf"
server_key_iv: "ecadbe40268ae55e5eebf7b2fba4c7e2"
server_key_version: "encryptionkey@0"
I20260807 19:49:15.141561 26176 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "d3db2a840c3a4641838d66810194ad5b"
format_stamp: "Formatted at 2026-08-07 19:49:15 on dist-test-slave-2p8l"
server_key: "f476123df24b91b1db474da43be5cadf"
server_key_iv: "ecadbe40268ae55e5eebf7b2fba4c7e2"
server_key_version: "encryptionkey@0"
I20260807 19:49:15.148149 26176 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.009s sys 0.000s
I20260807 19:49:15.152554 26201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:15.154531 26176 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:49:15.154702 26176 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "d3db2a840c3a4641838d66810194ad5b"
format_stamp: "Formatted at 2026-08-07 19:49:15 on dist-test-slave-2p8l"
server_key: "f476123df24b91b1db474da43be5cadf"
server_key_iv: "ecadbe40268ae55e5eebf7b2fba4c7e2"
server_key_version: "encryptionkey@0"
I20260807 19:49:15.154937 26176 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:15.173956 26176 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:15.179164 26176 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:15.179440 26176 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:15.183097 26176 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:15.183233 26176 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:15.183388 26176 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:15.183478 26176 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:49:15 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132155, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:15.214325 26214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.183995 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:54637 (local address 127.12.155.190:35507)
0807 19:49:15.184713 (+ 718us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.184723 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.186931 (+ 2208us) server_negotiation.cc:407] Connection header received
0807 19:49:15.189810 (+ 2879us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.189822 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.189978 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.190188 (+ 210us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:15.192833 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.194199 (+ 1366us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.196157 (+ 1958us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.196814 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.197001 (+ 187us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.203933 (+ 6932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:15.203946 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:15.203955 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:15.204016 (+ 61us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:15.208717 (+ 4701us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:15.210180 (+ 1463us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:15.210188 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:15.210195 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:15.210415 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:15.211180 (+ 765us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:15.211184 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:15.211186 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:15.211599 (+ 413us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:15.211828 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.213332 (+ 1504us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.213670 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":525,"thread_start_us":349,"threads_started":1}
I20260807 19:49:15.216830 26215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.184785 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.12.155.131:54637)
0807 19:49:15.186668 (+ 1883us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.186721 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.189267 (+ 2546us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.190406 (+ 1139us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.190416 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.191370 (+ 954us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:15.192548 (+ 1178us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.192583 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.194422 (+ 1839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.194433 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.195949 (+ 1516us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.195964 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.197176 (+ 1212us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.197188 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.197654 (+ 466us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.198885 (+ 1231us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:15.198935 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:15.203493 (+ 4558us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:15.208905 (+ 5412us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:15.208920 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:15.208955 (+ 35us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:15.209947 (+ 992us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:15.210611 (+ 664us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:15.210623 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:15.210630 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:15.211068 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:15.211810 (+ 742us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:15.211825 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:15.212678 (+ 853us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.213217 (+ 539us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.214263 (+ 1046us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1554,"thread_start_us":1247,"threads_started":1}
I20260807 19:49:15.239956 26401 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:40797 every 8 connection(s)
I20260807 19:49:15.239987 26176 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:40797
I20260807 19:49:15.242115 26176 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:15.244328 26353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.224959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.12.155.131:40807)
0807 19:49:15.226642 (+ 1683us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.226666 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.226831 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.227312 (+ 481us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.227320 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.228172 (+ 852us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:15.228814 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.228825 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.230562 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.230570 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.232374 (+ 1804us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.232390 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.233744 (+ 1354us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.233749 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.233880 (+ 131us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.234917 (+ 1037us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:15.234952 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:15.236262 (+ 1310us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:15.240967 (+ 4705us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:15.240972 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:15.240975 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:15.241425 (+ 450us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:15.241862 (+ 437us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:15.241865 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:15.241868 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:15.242000 (+ 132us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:15.242761 (+ 761us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:15.242770 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:15.243136 (+ 366us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.243340 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.243783 (+ 443us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1507,"thread_start_us":1329,"threads_started":1}
I20260807 19:49:15.245194 26214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.225550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:40807 (local address 127.12.155.190:35507)
0807 19:49:15.225827 (+ 277us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.225836 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.226778 (+ 942us) server_negotiation.cc:407] Connection header received
0807 19:49:15.226989 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.226998 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.227120 (+ 122us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.227263 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:15.229011 (+ 1748us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.230361 (+ 1350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.232546 (+ 2185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.233209 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.233410 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.236589 (+ 3179us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:15.236600 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:15.236609 (+ 9us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:15.236674 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:15.240823 (+ 4149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:15.241562 (+ 739us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:15.241568 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:15.241571 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:15.241746 (+ 175us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:15.242157 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:15.242164 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:15.242170 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:15.242584 (+ 414us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:15.242822 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.244707 (+ 1885us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.244920 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 19:49:15.245445 26408 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35507
I20260807 19:49:15.245714 26408 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:15.246697 26408 heartbeater.cc:511] Master 127.12.155.190:35507 requested a full tablet report, sending...
I20260807 19:49:15.248548 25623 ts_manager.cc:194] Registered new tserver with Master: d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:15.249816 25623 master_service.cc:496] Signed X509 certificate for tserver {username='oryx', principal='oryx/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:54637
I20260807 19:49:15.250133 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 26176
I20260807 19:49:15.250353 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:49:15.250972 12910 external_mini_cluster.cc:1428] Setting key de5c3817d861bb9bf16d678e11cfe0f5
I20260807 19:49:15.254657 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
Aug 07 19:49:15 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132155, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-user@KRBTEST.COM:
Aug 07 19:49:15 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:15 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-user@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:49:15.327466 26214 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:15.315052 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54716 (local address 127.12.155.190:35507)
0807 19:49:15.315362 (+ 310us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.315370 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.315627 (+ 257us) server_negotiation.cc:407] Connection header received
0807 19:49:15.315914 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.315919 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.316004 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.316128 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:15.317693 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.318578 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.320122 (+ 1544us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.320591 (+ 469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.320764 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.327131 (+ 6367us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54716: BlockingRecv error: recv got EOF from 127.0.0.1:54716 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 07 19:49:15 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132155, etypes {rep=17 tkt=17 ses=17}, test-user@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:15.347352 26214 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.331451 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54724 (local address 127.12.155.190:35507)
0807 19:49:15.331687 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.331693 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.332137 (+ 444us) server_negotiation.cc:407] Connection header received
0807 19:49:15.332312 (+ 175us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.332316 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.332394 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.332498 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:15.333917 (+ 1419us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.334755 (+ 838us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.336102 (+ 1347us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.336768 (+ 666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.336907 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.341279 (+ 4372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:15.341285 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:15.341288 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:15.341332 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:15.344498 (+ 3166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:15.345326 (+ 828us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:15.345330 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:15.345333 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:15.345477 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:15.345876 (+ 399us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:15.345879 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:15.345881 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:15.346251 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:15.346487 (+ 236us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.346761 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.346960 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:49:15.352653 25623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:49:15.360893 25623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:15.392472 26440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.377111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:40797 (local address 127.0.0.1:42952)
0807 19:49:15.379090 (+ 1979us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.379111 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.379232 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.380717 (+ 1485us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.380725 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.380767 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.381354 (+ 587us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.381376 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.384432 (+ 3056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.384437 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.388089 (+ 3652us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.388108 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.390725 (+ 2617us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.390734 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.391081 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.391182 (+ 101us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.391345 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.391666 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1843,"mutex_wait_us":49,"thread_start_us":1166,"threads_started":1}
I20260807 19:49:15.392508 26442 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.376997 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:35257 (local address 127.0.0.1:50128)
0807 19:49:15.378107 (+ 1110us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.378157 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.378384 (+ 227us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.381594 (+ 3210us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.381602 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.381639 (+ 37us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.382307 (+ 668us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.382325 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.385149 (+ 2824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.385157 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.388393 (+ 3236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.388414 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.391081 (+ 2667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.391091 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.391378 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.391432 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.391514 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.391718 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":740,"mutex_wait_us":36,"thread_start_us":1755,"threads_started":1}
I20260807 19:49:15.393743 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.377274 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50128 (local address 127.12.155.130:35257)
0807 19:49:15.380661 (+ 3387us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.380674 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.380712 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:49:15.380852 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.380863 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.381266 (+ 403us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.382607 (+ 1341us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.382944 (+ 337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.384945 (+ 2001us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.388679 (+ 3734us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.390741 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.392687 (+ 1946us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.393007 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.393119 (+ 112us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.393335 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3144,"thread_start_us":3265,"threads_started":1}
I20260807 19:49:15.394893 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.377944 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42952 (local address 127.12.155.131:40797)
0807 19:49:15.379919 (+ 1975us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.379930 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.379969 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:49:15.380096 (+ 127us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.380109 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.380428 (+ 319us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.381642 (+ 1214us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.382141 (+ 499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.384270 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.388354 (+ 4084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.390431 (+ 2077us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.394056 (+ 3625us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.394308 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.394394 (+ 86us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.394577 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1723,"thread_start_us":1862,"threads_started":1}
I20260807 19:49:15.398634 26292 tablet_service.cc:1467] Processing CreateTablet for tablet c696dca40f7f4cbb83c1b04eb500beb6 (DEFAULT_TABLE table=test-table [id=0a19dc8e42b04aaba81b3bd8f3304435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:15.398638 26067 tablet_service.cc:1467] Processing CreateTablet for tablet c696dca40f7f4cbb83c1b04eb500beb6 (DEFAULT_TABLE table=test-table [id=0a19dc8e42b04aaba81b3bd8f3304435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:15.400468 26292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c696dca40f7f4cbb83c1b04eb500beb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:15.400470 26067 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c696dca40f7f4cbb83c1b04eb500beb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:15.402179 26440 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.379240 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:39547 (local address 127.0.0.1:51240)
0807 19:49:15.393297 (+ 14057us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.393322 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.393435 (+ 113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.395375 (+ 1940us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.395381 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.395417 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.395597 (+ 180us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.395609 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.397522 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.397528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.399345 (+ 1817us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.399383 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.401296 (+ 1913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.401302 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.401500 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.401537 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.401647 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.401813 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13932,"thread_start_us":14013,"threads_started":1}
I20260807 19:49:15.402271 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.380323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51240 (local address 127.12.155.129:39547)
0807 19:49:15.394618 (+ 14295us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.394629 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.394663 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:49:15.394800 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.394809 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.395133 (+ 324us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.395376 (+ 243us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.395762 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.397344 (+ 1582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.399584 (+ 2240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.401101 (+ 1517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.401294 (+ 193us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.401478 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.401716 (+ 238us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.401900 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14101,"thread_start_us":13913,"threads_started":1}
I20260807 19:49:15.406937 25842 tablet_service.cc:1467] Processing CreateTablet for tablet c696dca40f7f4cbb83c1b04eb500beb6 (DEFAULT_TABLE table=test-table [id=0a19dc8e42b04aaba81b3bd8f3304435]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:15.408710 25842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c696dca40f7f4cbb83c1b04eb500beb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:15.414192 26448 tablet_bootstrap.cc:492] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Bootstrap starting.
I20260807 19:49:15.419014 26451 tablet_bootstrap.cc:492] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Bootstrap starting.
I20260807 19:49:15.419885 26448 tablet_bootstrap.cc:654] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:15.421690 26448 log.cc:824] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:15.423417 26451 tablet_bootstrap.cc:654] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:15.424865 26451 log.cc:824] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:15.425666 26448 tablet_bootstrap.cc:492] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: No bootstrap required, opened a new log
I20260807 19:49:15.425791 26455 tablet_bootstrap.cc:492] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Bootstrap starting.
I20260807 19:49:15.426656 26448 ts_tablet_manager.cc:1397] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Time spent bootstrapping tablet: real 0.012s user 0.010s sys 0.000s
I20260807 19:49:15.430006 26455 tablet_bootstrap.cc:654] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:15.431357 26455 log.cc:824] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:15.435042 26451 tablet_bootstrap.cc:492] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: No bootstrap required, opened a new log
I20260807 19:49:15.435051 26455 tablet_bootstrap.cc:492] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: No bootstrap required, opened a new log
I20260807 19:49:15.435379 26451 ts_tablet_manager.cc:1397] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Time spent bootstrapping tablet: real 0.017s user 0.007s sys 0.007s
I20260807 19:49:15.435386 26455 ts_tablet_manager.cc:1397] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent bootstrapping tablet: real 0.010s user 0.004s sys 0.004s
I20260807 19:49:15.439787 26448 raft_consensus.cc:348] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.440384 26448 raft_consensus.cc:374] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:15.440526 26448 raft_consensus.cc:729] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ec4ee4b7c44707982aff8916776231, State: Initialized, Role: FOLLOWER
I20260807 19:49:15.441840 26448 consensus_queue.cc:260] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.444238 26451 raft_consensus.cc:348] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.444700 26451 raft_consensus.cc:374] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:15.444880 26451 raft_consensus.cc:729] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3db2a840c3a4641838d66810194ad5b, State: Initialized, Role: FOLLOWER
I20260807 19:49:15.445758 26170 heartbeater.cc:503] Master 127.12.155.190:35507 was elected leader, sending a full tablet report...
I20260807 19:49:15.445645 26451 consensus_queue.cc:260] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.446410 26448 ts_tablet_manager.cc:1428] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Time spent starting tablet: real 0.020s user 0.019s sys 0.000s
I20260807 19:49:15.447619 26408 heartbeater.cc:503] Master 127.12.155.190:35507 was elected leader, sending a full tablet report...
I20260807 19:49:15.448284 26451 ts_tablet_manager.cc:1428] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
I20260807 19:49:15.447243 26455 raft_consensus.cc:348] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.448621 26455 raft_consensus.cc:374] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:15.448752 26455 raft_consensus.cc:729] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Initialized, Role: FOLLOWER
I20260807 19:49:15.449448 26455 consensus_queue.cc:260] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.451345 26455 ts_tablet_manager.cc:1428] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent starting tablet: real 0.016s user 0.012s sys 0.004s
W20260807 19:49:15.494532 26413 tablet.cc:2369] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:15.520334 26460 raft_consensus.cc:482] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:15.520829 26460 raft_consensus.cc:504] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.521216 26459 raft_consensus.cc:482] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:15.521580 26459 raft_consensus.cc:504] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.523260 26460 leader_election.cc:288] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:15.523898 26459 leader_election.cc:288] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547)
I20260807 19:49:15.534683 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.525008 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:37067 (local address 127.12.155.129:39547)
0807 19:49:15.525211 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.525217 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.525243 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:49:15.525296 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.525300 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.525382 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.525465 (+ 83us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.526189 (+ 724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.527744 (+ 1555us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.531654 (+ 3910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.533287 (+ 1633us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.533455 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.533545 (+ 90us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.534151 (+ 606us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.534326 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:49:15.535480 26215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.524192 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:39547 (local address 127.12.155.131:37067)
0807 19:49:15.524819 (+ 627us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.524842 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.525037 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.525659 (+ 622us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.525665 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.525694 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.525958 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.525973 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.528018 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.528027 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.531363 (+ 3336us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.531389 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.533645 (+ 2256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.533651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.533879 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.533919 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.534013 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.535153 (+ 1140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487}
I20260807 19:49:15.537135 25876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "d3db2a840c3a4641838d66810194ad5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" is_pre_election: true
I20260807 19:49:15.537789 25876 raft_consensus.cc:2454] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate d3db2a840c3a4641838d66810194ad5b in term 0.
I20260807 19:49:15.538931 26202 leader_election.cc:302] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, d3db2a840c3a4641838d66810194ad5b; no voters:
I20260807 19:49:15.539533 26459 raft_consensus.cc:2781] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:15.539691 26459 raft_consensus.cc:482] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:15.539798 26443 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.524466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:41707 (local address 127.12.155.130:35257)
0807 19:49:15.524722 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.524727 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.524928 (+ 201us) server_negotiation.cc:407] Connection header received
0807 19:49:15.525269 (+ 341us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.525275 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.525374 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.525450 (+ 76us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.533078 (+ 7628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.534233 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.537110 (+ 2877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.538444 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.538591 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.538676 (+ 85us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.539334 (+ 658us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.539489 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":91}
I20260807 19:49:15.539808 26459 raft_consensus.cc:3037] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:15.540679 26462 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.523776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:35257 (local address 127.12.155.129:41707)
0807 19:49:15.524793 (+ 1017us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.524828 (+ 35us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.525060 (+ 232us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.525688 (+ 628us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.525693 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.525714 (+ 21us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.532321 (+ 6607us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.532335 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.534442 (+ 2107us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.534447 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.536785 (+ 2338us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.536799 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.538938 (+ 2139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.538946 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.539126 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.539161 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.540105 (+ 944us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.540286 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":852,"thread_start_us":947,"threads_started":1}
I20260807 19:49:15.541771 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231" is_pre_election: true
I20260807 19:49:15.542466 26092 raft_consensus.cc:2454] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:15.543318 25764 leader_election.cc:302] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231; no voters:
I20260807 19:49:15.543740 26460 raft_consensus.cc:2781] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:15.543892 26460 raft_consensus.cc:482] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:15.544031 26460 raft_consensus.cc:3037] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:15.544374 26459 raft_consensus.cc:504] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.545483 26459 leader_election.cc:288] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [CANDIDATE]: Term 1 election: Requested vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547)
I20260807 19:49:15.547894 26460 raft_consensus.cc:504] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
I20260807 19:49:15.549510 26460 leader_election.cc:288] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Requested vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:15.550482 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231"
I20260807 19:49:15.550765 26092 raft_consensus.cc:3037] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:15.548696 25876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "d3db2a840c3a4641838d66810194ad5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49"
I20260807 19:49:15.552076 25876 raft_consensus.cc:2379] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3db2a840c3a4641838d66810194ad5b in current term 1: Already voted for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in this term.
I20260807 19:49:15.553656 26444 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.523763 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:60899 (local address 127.12.155.131:40797)
0807 19:49:15.524637 (+ 874us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.524648 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.543020 (+ 18372us) server_negotiation.cc:407] Connection header received
0807 19:49:15.543382 (+ 362us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.543390 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.543498 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.543580 (+ 82us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.544713 (+ 1133us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.546310 (+ 1597us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.549730 (+ 3420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.551899 (+ 2169us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.552082 (+ 183us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.552198 (+ 116us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.553080 (+ 882us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.553263 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":648}
I20260807 19:49:15.554733 26463 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.524046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:40797 (local address 127.12.155.129:60899)
0807 19:49:15.542857 (+ 18811us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.542886 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.543174 (+ 288us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.543848 (+ 674us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.543857 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.543911 (+ 54us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.544423 (+ 512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.544438 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.546564 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.546573 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.549514 (+ 2941us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.549531 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.552520 (+ 2989us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.552530 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.552802 (+ 272us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.552848 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.553990 (+ 1142us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.554218 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":18646,"thread_start_us":18446,"threads_started":1}
I20260807 19:49:15.554904 26092 raft_consensus.cc:2454] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:15.555388 26465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.526193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:56761 (local address 127.12.155.130:35257)
0807 19:49:15.536297 (+ 10104us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.536306 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.546114 (+ 9808us) server_negotiation.cc:407] Connection header received
0807 19:49:15.546186 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.546191 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.546283 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.546374 (+ 91us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:15.547177 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.548487 (+ 1310us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.552020 (+ 3533us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.553784 (+ 1764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.554038 (+ 254us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.554163 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.554826 (+ 663us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.555001 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":9893,"thread_start_us":10665,"threads_started":1}
I20260807 19:49:15.555449 26215 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.525533 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:35257 (local address 127.12.155.131:56761)
0807 19:49:15.545850 (+ 20317us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:15.545871 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:15.545994 (+ 123us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:15.546714 (+ 720us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:15.546722 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:15.546750 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:15.546996 (+ 246us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.547006 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.548666 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.548675 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.551652 (+ 2977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:15.551674 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.554310 (+ 2636us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.554318 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:15.554574 (+ 256us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.554621 (+ 47us) client_negotiation.cc:769] Sending connection context
0807 19:49:15.554765 (+ 144us) client_negotiation.cc:240] Negotiation successful
0807 19:49:15.554952 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":20196,"mutex_wait_us":623,"thread_start_us":25496,"threads_started":1}
I20260807 19:49:15.555487 25764 leader_election.cc:302] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231; no voters:
I20260807 19:49:15.556408 26460 raft_consensus.cc:2781] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:15.556262 26326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b"
I20260807 19:49:15.556337 26328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b" is_pre_election: true
I20260807 19:49:15.556952 26326 raft_consensus.cc:2379] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in current term 1: Already voted for candidate d3db2a840c3a4641838d66810194ad5b in this term.
I20260807 19:49:15.556887 26091 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "d3db2a840c3a4641838d66810194ad5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231"
I20260807 19:49:15.557384 26091 raft_consensus.cc:2379] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate d3db2a840c3a4641838d66810194ad5b in current term 1: Already voted for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in this term.
I20260807 19:49:15.557695 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c696dca40f7f4cbb83c1b04eb500beb6" candidate_uuid: "d3db2a840c3a4641838d66810194ad5b" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231" is_pre_election: true
I20260807 19:49:15.558030 26092 raft_consensus.cc:2379] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate d3db2a840c3a4641838d66810194ad5b in current term 1: Already voted for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in this term.
I20260807 19:49:15.558482 26208 leader_election.cc:302] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: d3db2a840c3a4641838d66810194ad5b; no voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231
I20260807 19:49:15.558902 26459 raft_consensus.cc:2726] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20260807 19:49:15.559904 26460 raft_consensus.cc:686] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Becoming Leader. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Running, Role: LEADER
I20260807 19:49:15.560671 26460 consensus_queue.cc:237] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } }
W20260807 19:49:15.565434 26171 tablet.cc:2369] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:15.567343 25623 catalog_manager.cc:5495] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } health_report { overall_health: HEALTHY } } }
I20260807 19:49:15.632790 26447 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:15.626671 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51248 (local address 127.12.155.129:39547)
0807 19:49:15.626923 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:15.626928 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:15.626950 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:49:15.627203 (+ 253us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:15.627208 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:15.627310 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:15.627472 (+ 162us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:15.627842 (+ 370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.628828 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.630347 (+ 1519us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:15.630766 (+ 419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:15.630891 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:15.631377 (+ 486us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:15.632078 (+ 701us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:15.632201 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:15.632294 (+ 93us) server_negotiation.cc:299] Negotiation successful
0807 19:49:15.632375 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 19:49:15.643481 26326 raft_consensus.cc:1261] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Refusing update from remote peer 5b5bb5247a4249ee9527f4cfa23c4e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:15.643466 26092 raft_consensus.cc:1261] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Refusing update from remote peer 5b5bb5247a4249ee9527f4cfa23c4e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:15.644541 26466 consensus_queue.cc:1035] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:15.645006 26460 consensus_queue.cc:1035] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:15.677955 25623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:15.678369 25623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:15.683288 25623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Sending DeleteTablet for 3 replicas of tablet c696dca40f7f4cbb83c1b04eb500beb6
I20260807 19:49:15.685024 26292 tablet_service.cc:1514] Processing DeleteTablet for tablet c696dca40f7f4cbb83c1b04eb500beb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:15 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42952
I20260807 19:49:15.684983 26067 tablet_service.cc:1514] Processing DeleteTablet for tablet c696dca40f7f4cbb83c1b04eb500beb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:15 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:50128
I20260807 19:49:15.685526 25842 tablet_service.cc:1514] Processing DeleteTablet for tablet c696dca40f7f4cbb83c1b04eb500beb6 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:15 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 19:49:15.690629 25623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54724:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:49:15.692909 25623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:15.711915 26065 tablet_service.cc:1467] Processing CreateTablet for tablet df936fe803b14fadaf42b894fbb1664d (DEFAULT_TABLE table=test-table [id=d7870f145fa14794a41f01451f7ca1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:15.712332 26291 tablet_service.cc:1467] Processing CreateTablet for tablet df936fe803b14fadaf42b894fbb1664d (DEFAULT_TABLE table=test-table [id=d7870f145fa14794a41f01451f7ca1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:15.712993 26065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df936fe803b14fadaf42b894fbb1664d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:15.713196 26291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df936fe803b14fadaf42b894fbb1664d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:15.714912 25841 tablet_service.cc:1467] Processing CreateTablet for tablet df936fe803b14fadaf42b894fbb1664d (DEFAULT_TABLE table=test-table [id=d7870f145fa14794a41f01451f7ca1b2]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:15.715794 25841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet df936fe803b14fadaf42b894fbb1664d. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:15.729550 26451 tablet_bootstrap.cc:492] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Bootstrap starting.
I20260807 19:49:15.730486 26488 tablet_replica.cc:330] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: stopping tablet replica
I20260807 19:49:15.731827 26451 tablet_bootstrap.cc:654] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:15.733392 26489 tablet_replica.cc:330] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: stopping tablet replica
I20260807 19:49:15.734050 26488 raft_consensus.cc:2229] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:15.734992 26488 raft_consensus.cc:2258] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:15.736095 26489 raft_consensus.cc:2229] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:15.737521 26486 tablet_replica.cc:330] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: stopping tablet replica
I20260807 19:49:15.738128 26486 raft_consensus.cc:2229] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:15.738587 26488 ts_tablet_manager.cc:1905] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:15.738839 26486 raft_consensus.cc:2258] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:15.742304 26486 ts_tablet_manager.cc:1905] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:15.745704 26489 raft_consensus.cc:2258] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:15.746311 26455 tablet_bootstrap.cc:492] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Bootstrap starting.
I20260807 19:49:15.748200 26489 ts_tablet_manager.cc:1905] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:15.748478 26455 tablet_bootstrap.cc:654] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:15.748683 26488 ts_tablet_manager.cc:1918] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:15.748944 26488 log.cc:1196] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/c696dca40f7f4cbb83c1b04eb500beb6
I20260807 19:49:15.749650 26488 ts_tablet_manager.cc:1939] T c696dca40f7f4cbb83c1b04eb500beb6 P d3db2a840c3a4641838d66810194ad5b: Deleting consensus metadata
I20260807 19:49:15.751273 26448 tablet_bootstrap.cc:492] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Bootstrap starting.
I20260807 19:49:15.753001 25600 catalog_manager.cc:4841] TS d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797): tablet c696dca40f7f4cbb83c1b04eb500beb6 (table test-table [id=0a19dc8e42b04aaba81b3bd8f3304435]) successfully deleted
I20260807 19:49:15.753386 26448 tablet_bootstrap.cc:654] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:15.753321 26486 ts_tablet_manager.cc:1918] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:15.753712 26486 log.cc:1196] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/c696dca40f7f4cbb83c1b04eb500beb6
I20260807 19:49:15.754513 26455 tablet_bootstrap.cc:492] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: No bootstrap required, opened a new log
I20260807 19:49:15.754729 26455 ts_tablet_manager.cc:1397] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.000s
I20260807 19:49:15.755859 26455 raft_consensus.cc:348] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:15.756201 26455 raft_consensus.cc:374] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:15.756304 26455 raft_consensus.cc:729] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Initialized, Role: FOLLOWER
I20260807 19:49:15.756712 26486 ts_tablet_manager.cc:1939] T c696dca40f7f4cbb83c1b04eb500beb6 P 91ec4ee4b7c44707982aff8916776231: Deleting consensus metadata
I20260807 19:49:15.756649 26455 consensus_queue.cc:260] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:15.757011 26448 tablet_bootstrap.cc:492] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: No bootstrap required, opened a new log
I20260807 19:49:15.757194 26448 ts_tablet_manager.cc:1397] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 19:49:15.758208 26448 raft_consensus.cc:348] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:15.758488 26448 raft_consensus.cc:374] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:15.758607 26448 raft_consensus.cc:729] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ec4ee4b7c44707982aff8916776231, State: Initialized, Role: FOLLOWER
I20260807 19:49:15.759152 26455 ts_tablet_manager.cc:1428] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20260807 19:49:15.758884 26448 consensus_queue.cc:260] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:15.759729 26448 ts_tablet_manager.cc:1428] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 19:49:15.760877 26451 tablet_bootstrap.cc:492] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: No bootstrap required, opened a new log
I20260807 19:49:15.761137 26451 ts_tablet_manager.cc:1397] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Time spent bootstrapping tablet: real 0.032s user 0.009s sys 0.009s
I20260807 19:49:15.762281 26451 raft_consensus.cc:348] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:15.762621 26451 raft_consensus.cc:374] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:15.762734 26451 raft_consensus.cc:729] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3db2a840c3a4641838d66810194ad5b, State: Initialized, Role: FOLLOWER
I20260807 19:49:15.763038 26451 consensus_queue.cc:260] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:15.763593 26451 ts_tablet_manager.cc:1428] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Time spent starting tablet: real 0.002s user 0.000s sys 0.002s
I20260807 19:49:15.766031 26489 ts_tablet_manager.cc:1918] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:15.766412 26489 log.cc:1196] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/c696dca40f7f4cbb83c1b04eb500beb6
I20260807 19:49:15.767026 26489 ts_tablet_manager.cc:1939] T c696dca40f7f4cbb83c1b04eb500beb6 P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting consensus metadata
I20260807 19:49:15.768199 25605 catalog_manager.cc:4841] TS 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257): tablet c696dca40f7f4cbb83c1b04eb500beb6 (table test-table [id=0a19dc8e42b04aaba81b3bd8f3304435]) successfully deleted
I20260807 19:49:15.769064 25600 catalog_manager.cc:4841] TS 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547): tablet c696dca40f7f4cbb83c1b04eb500beb6 (table test-table [id=0a19dc8e42b04aaba81b3bd8f3304435]) successfully deleted
W20260807 19:49:15.915680 25959 tablet.cc:2369] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:16.040717 26477 raft_consensus.cc:482] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:16.041033 26477 raft_consensus.cc:504] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.042152 26477 leader_election.cc:288] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:16.043012 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df936fe803b14fadaf42b894fbb1664d" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231" is_pre_election: true
I20260807 19:49:16.043365 26092 raft_consensus.cc:2454] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:16.043978 25764 leader_election.cc:302] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231; no voters:
I20260807 19:49:16.043881 26326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df936fe803b14fadaf42b894fbb1664d" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b" is_pre_election: true
I20260807 19:49:16.044317 26477 raft_consensus.cc:2781] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:16.044288 26326 raft_consensus.cc:2454] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:16.044471 26477 raft_consensus.cc:482] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:16.044579 26477 raft_consensus.cc:3037] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:16.048755 26477 raft_consensus.cc:504] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.050354 26326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df936fe803b14fadaf42b894fbb1664d" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b"
I20260807 19:49:16.050385 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "df936fe803b14fadaf42b894fbb1664d" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231"
I20260807 19:49:16.050680 26326 raft_consensus.cc:3037] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:16.050704 26092 raft_consensus.cc:3037] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:16.054761 26092 raft_consensus.cc:2454] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:16.055012 26326 raft_consensus.cc:2454] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:16.055559 25764 leader_election.cc:302] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231; no voters:
I20260807 19:49:16.056119 26466 raft_consensus.cc:2781] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:16.056924 26477 leader_election.cc:288] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Requested vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:16.056957 26466 raft_consensus.cc:686] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Becoming Leader. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Running, Role: LEADER
I20260807 19:49:16.057464 26466 consensus_queue.cc:237] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.061641 25623 catalog_manager.cc:5495] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } health_report { overall_health: UNKNOWN } } }
Aug 07 19:49:16 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132153, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.190@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:16.187482 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.153747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35507 (local address 127.0.0.1:54356)
0807 19:49:16.170890 (+ 17143us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:16.170922 (+ 32us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:16.171192 (+ 270us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:16.171768 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:16.171776 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:16.172832 (+ 1056us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:16.173126 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.173139 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.174609 (+ 1470us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.174618 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.175772 (+ 1154us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.175790 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.176589 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.176594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.176796 (+ 202us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.177671 (+ 875us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:16.177698 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:16.180666 (+ 2968us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:16.184409 (+ 3743us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:16.184429 (+ 20us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:16.184439 (+ 10us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:16.184921 (+ 482us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:16.185302 (+ 381us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:16.185308 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:16.185312 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:16.185477 (+ 165us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:16.186108 (+ 631us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:16.186118 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:16.186331 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 19:49:16.186535 (+ 204us) client_negotiation.cc:240] Negotiation successful
0807 19:49:16.186962 (+ 427us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16925,"mutex_wait_us":64,"thread_start_us":16731,"threads_started":1}
I20260807 19:49:16.187507 26509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.153744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54356 (local address 127.12.155.190:35507)
0807 19:49:16.171425 (+ 17681us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.171430 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.171450 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:49:16.171504 (+ 54us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.171508 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.171575 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.171725 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:16.173337 (+ 1612us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.174459 (+ 1122us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.175942 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.176391 (+ 449us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.176538 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.180935 (+ 4397us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:16.180940 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:16.180944 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:16.180977 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:16.184257 (+ 3280us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:16.185049 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:16.185056 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:16.185062 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:16.185193 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:16.185587 (+ 394us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:16.185594 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:16.185598 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:16.185944 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:16.186150 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:16.186631 (+ 481us) server_negotiation.cc:299] Negotiation successful
0807 19:49:16.187084 (+ 453us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":177,"server-negotiator.queue_time_us":17520,"thread_start_us":18140,"threads_started":1}
I20260807 19:49:16.194427 25623 catalog_manager.cc:1908] Servicing CreateTable request from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:54356:
name: "kudu_system.kudu_transactions"
schema {
columns {
name: "txn_id"
type: INT64
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "entry_type"
type: INT8
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "identifier"
type: STRING
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "metadata"
type: STRING
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "<redacted>""\006\001\000\000\000\000\000\000\000\000\007\001@B\017\000\000\000\000\000"
indirect_data: "<redacted>"""
}
partition_schema {
range_schema {
columns {
name: "txn_id"
}
}
}
table_type: TXN_STATUS_TABLE
W20260807 19:49:16.195719 25623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table kudu_system.kudu_transactions in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:16.204375 26065 tablet_service.cc:1467] Processing CreateTablet for tablet a156884808b843e7b7249a9d0b957aa8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=70db3ed0403a4901a818fc1f7aef8f73]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:49:16.204820 26292 tablet_service.cc:1467] Processing CreateTablet for tablet a156884808b843e7b7249a9d0b957aa8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=70db3ed0403a4901a818fc1f7aef8f73]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:49:16.205152 26065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a156884808b843e7b7249a9d0b957aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:16.205463 26292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a156884808b843e7b7249a9d0b957aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:16.210947 25841 tablet_service.cc:1467] Processing CreateTablet for tablet a156884808b843e7b7249a9d0b957aa8 (TXN_STATUS_TABLE table=kudu_system.kudu_transactions [id=70db3ed0403a4901a818fc1f7aef8f73]), partition=RANGE (txn_id) PARTITION 0 <= VALUES < 1000000
I20260807 19:49:16.211598 25841 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet a156884808b843e7b7249a9d0b957aa8. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:16.213632 26448 tablet_bootstrap.cc:492] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: Bootstrap starting.
I20260807 19:49:16.216498 26448 tablet_bootstrap.cc:654] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:16.226445 26448 tablet_bootstrap.cc:492] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: No bootstrap required, opened a new log
I20260807 19:49:16.226883 26448 ts_tablet_manager.cc:1397] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: Time spent bootstrapping tablet: real 0.013s user 0.003s sys 0.008s
I20260807 19:49:16.227727 26451 tablet_bootstrap.cc:492] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: Bootstrap starting.
I20260807 19:49:16.228133 26448 raft_consensus.cc:348] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.228502 26448 raft_consensus.cc:374] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:16.228596 26448 raft_consensus.cc:729] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ec4ee4b7c44707982aff8916776231, State: Initialized, Role: FOLLOWER
I20260807 19:49:16.229086 26448 consensus_queue.cc:260] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.229718 26458 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.230572 26451 tablet_bootstrap.cc:654] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:16.231467 26455 tablet_bootstrap.cc:492] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: Bootstrap starting.
I20260807 19:49:16.234712 26455 tablet_bootstrap.cc:654] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:16.230178 26458 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.238487 26455 tablet_bootstrap.cc:492] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: No bootstrap required, opened a new log
I20260807 19:49:16.238834 26455 ts_tablet_manager.cc:1397] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent bootstrapping tablet: real 0.007s user 0.006s sys 0.000s
I20260807 19:49:16.240092 26455 raft_consensus.cc:348] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.240511 26455 raft_consensus.cc:374] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:16.240635 26455 raft_consensus.cc:729] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Initialized, Role: FOLLOWER
I20260807 19:49:16.241019 26455 consensus_queue.cc:260] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.241716 26466 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.237299 26448 ts_tablet_manager.cc:1428] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: Time spent starting tablet: real 0.010s user 0.000s sys 0.002s
I20260807 19:49:16.242038 26455 ts_tablet_manager.cc:1428] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent starting tablet: real 0.003s user 0.002s sys 0.000s
I20260807 19:49:16.242036 26466 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.248904 26451 tablet_bootstrap.cc:492] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: No bootstrap required, opened a new log
I20260807 19:49:16.249184 26451 ts_tablet_manager.cc:1397] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: Time spent bootstrapping tablet: real 0.022s user 0.000s sys 0.011s
I20260807 19:49:16.250301 26451 raft_consensus.cc:348] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.250671 26451 raft_consensus.cc:374] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:16.250902 26451 raft_consensus.cc:729] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3db2a840c3a4641838d66810194ad5b, State: Initialized, Role: FOLLOWER
I20260807 19:49:16.251281 26451 consensus_queue.cc:260] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.251825 26459 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: TxnStatusTablet state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.252019 26451 ts_tablet_manager.cc:1428] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:49:16.252166 26459 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.515679 26458 raft_consensus.cc:482] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:16.516125 26458 raft_consensus.cc:504] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.518278 26458 leader_election.cc:288] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:16.520332 26466 raft_consensus.cc:482] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:16.520604 26466 raft_consensus.cc:504] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.521545 26466 leader_election.cc:288] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:16.522462 26326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a156884808b843e7b7249a9d0b957aa8" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b" is_pre_election: true
I20260807 19:49:16.522842 26326 raft_consensus.cc:2454] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:16.522787 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a156884808b843e7b7249a9d0b957aa8" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231" is_pre_election: true
I20260807 19:49:16.523135 26092 raft_consensus.cc:2454] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:16.523494 25759 leader_election.cc:302] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, d3db2a840c3a4641838d66810194ad5b; no voters:
I20260807 19:49:16.523885 26466 raft_consensus.cc:2781] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:16.524021 26466 raft_consensus.cc:482] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:16.524122 26466 raft_consensus.cc:3037] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:16.527194 26466 raft_consensus.cc:504] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.528389 26519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.519856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:41399 (local address 127.12.155.131:40797)
0807 19:49:16.520806 (+ 950us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.520813 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.520845 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:49:16.520957 (+ 112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.520970 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.521102 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.521218 (+ 116us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:16.522039 (+ 821us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.523332 (+ 1293us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.526345 (+ 3013us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.527184 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.527398 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.527494 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:16.527869 (+ 375us) server_negotiation.cc:299] Negotiation successful
0807 19:49:16.528027 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":764,"spinlock_wait_cycles":4352,"thread_start_us":724,"threads_started":1}
I20260807 19:49:16.528499 26518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.519571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:40797 (local address 127.12.155.130:41399)
0807 19:49:16.520173 (+ 602us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:16.520195 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:16.520327 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:16.521398 (+ 1071us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:16.521404 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:16.521435 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:16.521827 (+ 392us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.521840 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.523527 (+ 1687us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.523532 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.526097 (+ 2565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.526115 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.527392 (+ 1277us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.527398 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.527604 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.527633 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:49:16.527796 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 19:49:16.527959 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"mutex_wait_us":84,"thread_start_us":329,"threads_started":1}
I20260807 19:49:16.528754 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a156884808b843e7b7249a9d0b957aa8" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231"
I20260807 19:49:16.529091 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.518724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:39403 (local address 127.12.155.129:39547)
0807 19:49:16.519431 (+ 707us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.519439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.519467 (+ 28us) server_negotiation.cc:407] Connection header received
0807 19:49:16.519801 (+ 334us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.519809 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.519934 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.520136 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:16.520872 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.522111 (+ 1239us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.526285 (+ 4174us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.527661 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.527876 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.527963 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:16.528589 (+ 626us) server_negotiation.cc:299] Negotiation successful
0807 19:49:16.528754 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":406,"threads_started":1}
I20260807 19:49:16.529058 26092 raft_consensus.cc:3037] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:16.529551 26516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.518621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:39547 (local address 127.12.155.130:39403)
0807 19:49:16.519342 (+ 721us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:16.519369 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:16.519564 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:16.520198 (+ 634us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:16.520204 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:16.520262 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:16.520624 (+ 362us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.520638 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.522287 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.522292 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.526104 (+ 3812us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.526115 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.528114 (+ 1999us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.528122 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.528308 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.528362 (+ 54us) client_negotiation.cc:769] Sending connection context
0807 19:49:16.528461 (+ 99us) client_negotiation.cc:240] Negotiation successful
0807 19:49:16.529220 (+ 759us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":568,"mutex_wait_us":317,"thread_start_us":406,"threads_started":1}
I20260807 19:49:16.530051 26466 leader_election.cc:288] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Requested vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:16.529989 26326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a156884808b843e7b7249a9d0b957aa8" candidate_uuid: "91ec4ee4b7c44707982aff8916776231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b" is_pre_election: true
I20260807 19:49:16.530332 26326 raft_consensus.cc:2454] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91ec4ee4b7c44707982aff8916776231 in term 0.
I20260807 19:49:16.530494 25876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a156884808b843e7b7249a9d0b957aa8" candidate_uuid: "91ec4ee4b7c44707982aff8916776231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" is_pre_election: true
I20260807 19:49:16.530776 26326 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a156884808b843e7b7249a9d0b957aa8" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b"
I20260807 19:49:16.530912 25876 raft_consensus.cc:2379] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 91ec4ee4b7c44707982aff8916776231 in current term 1: Already voted for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in this term.
I20260807 19:49:16.531014 26326 raft_consensus.cc:3037] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:16.531072 25985 leader_election.cc:302] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91ec4ee4b7c44707982aff8916776231, d3db2a840c3a4641838d66810194ad5b; no voters:
I20260807 19:49:16.532469 26092 raft_consensus.cc:2454] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:16.532667 26458 raft_consensus.cc:2741] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20260807 19:49:16.533056 25764 leader_election.cc:302] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231; no voters:
I20260807 19:49:16.533404 26466 raft_consensus.cc:2781] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:16.533563 26466 raft_consensus.cc:686] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Becoming Leader. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Running, Role: LEADER
I20260807 19:49:16.534108 26326 raft_consensus.cc:2454] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:16.533916 26466 consensus_queue.cc:237] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.535974 26477 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: TxnStatusTablet state changed. Reason: New leader 5b5bb5247a4249ee9527f4cfa23c4e49. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.536346 26477 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:49:16.537020 26523 txn_status_manager.cc:873] Waiting until node catch up with all replicated operations in previous term...
I20260807 19:49:16.537276 26523 txn_status_manager.cc:929] Loading transaction status metadata into memory...
I20260807 19:49:16.537994 25624 catalog_manager.cc:5495] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } health_report { overall_health: UNKNOWN } } }
I20260807 19:49:16.611958 26508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.605962 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:39547 (local address 127.0.0.1:56138)
0807 19:49:16.606351 (+ 389us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:16.606371 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:16.606580 (+ 209us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:16.607084 (+ 504us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:16.607090 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:16.607105 (+ 15us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:49:16.607328 (+ 223us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.607338 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.608507 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.608516 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.609599 (+ 1083us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.609612 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.610498 (+ 886us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.610505 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.610712 (+ 207us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.610788 (+ 76us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:49:16.611285 (+ 497us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:49:16.611315 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:49:16.611430 (+ 115us) client_negotiation.cc:240] Negotiation successful
0807 19:49:16.611617 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 19:49:16.611958 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.605964 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56138 (local address 127.12.155.129:39547)
0807 19:49:16.606281 (+ 317us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.606290 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.606461 (+ 171us) server_negotiation.cc:407] Connection header received
0807 19:49:16.606838 (+ 377us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.606842 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.606929 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.607045 (+ 116us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:16.607486 (+ 441us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.608349 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.609758 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.610317 (+ 559us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.610457 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.611039 (+ 582us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:16.611171 (+ 132us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:16.611285 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:16.611458 (+ 173us) server_negotiation.cc:299] Negotiation successful
0807 19:49:16.611556 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":145}
I20260807 19:49:16.617802 26092 raft_consensus.cc:1261] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Refusing update from remote peer 5b5bb5247a4249ee9527f4cfa23c4e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:16.617795 26326 raft_consensus.cc:1261] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Refusing update from remote peer 5b5bb5247a4249ee9527f4cfa23c4e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:16.618623 26477 consensus_queue.cc:1035] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:16.618974 26466 consensus_queue.cc:1035] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:16.626894 26459 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: TxnStatusTablet state changed. Reason: New leader 5b5bb5247a4249ee9527f4cfa23c4e49. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.627300 26459 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.630581 26526 mvcc.cc:205] Tried to move back new op lower bound from 7315997313498251264 to 7315997313166249984. Current Snapshot: MvccSnapshot[applied={T|T < 7315997313498251264}]
I20260807 19:49:16.630676 26528 mvcc.cc:205] Tried to move back new op lower bound from 7315997313498251264 to 7315997313166249984. Current Snapshot: MvccSnapshot[applied={T|T < 7315997313498251264}]
I20260807 19:49:16.635167 26477 consensus_queue.cc:1035] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:16.639986 26458 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: TxnStatusTablet state changed. Reason: New leader 5b5bb5247a4249ee9527f4cfa23c4e49. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.640487 26458 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.643316 26529 mvcc.cc:205] Tried to move back new op lower bound from 7315997313498251264 to 7315997313166249984. Current Snapshot: MvccSnapshot[applied={T|T < 7315997313498251264}]
I20260807 19:49:16.651172 26477 consensus_queue.cc:1035] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:16.656911 26459 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.657371 26459 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P d3db2a840c3a4641838d66810194ad5b: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.659008 26458 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: TxnStatusTablet state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.659422 26458 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 91ec4ee4b7c44707982aff8916776231: This TxnStatusTablet replica's current role is: FOLLOWER
I20260807 19:49:16.668088 26477 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.668440 26477 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:49:16.675092 26477 tablet_replica.cc:439] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: TxnStatusTablet state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } } }
I20260807 19:49:16.675454 26477 tablet_replica.cc:442] T a156884808b843e7b7249a9d0b957aa8 P 5b5bb5247a4249ee9527f4cfa23c4e49: This TxnStatusTablet replica's current role is: LEADER
I20260807 19:49:16.701290 26517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.694876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:37149 (local address 127.12.155.129:39547)
0807 19:49:16.695088 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.695093 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.695754 (+ 661us) server_negotiation.cc:407] Connection header received
0807 19:49:16.696013 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.696018 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.696096 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.696188 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:16.696779 (+ 591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.697613 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.699256 (+ 1643us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.699709 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.699866 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.700315 (+ 449us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:16.700438 (+ 123us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:16.700539 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:16.700685 (+ 146us) server_negotiation.cc:299] Negotiation successful
0807 19:49:16.700814 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":22,"server-negotiator.queue_time_us":71}
I20260807 19:49:16.701331 26555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.694955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:39547 (local address 127.12.155.129:37149)
0807 19:49:16.695635 (+ 680us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:16.695652 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:16.695855 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:16.696211 (+ 356us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:16.696216 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:16.696227 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:49:16.696603 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.696612 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.697749 (+ 1137us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.697757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.699109 (+ 1352us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:16.699123 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.699934 (+ 811us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.699943 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:16.700062 (+ 119us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.700123 (+ 61us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:49:16.700537 (+ 414us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:49:16.700548 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:49:16.700662 (+ 114us) client_negotiation.cc:240] Negotiation successful
0807 19:49:16.700847 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":519,"mutex_wait_us":6,"thread_start_us":371,"threads_started":1}
I20260807 19:49:16.771579 25624 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:16.771883 25624 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-user', principal='test-user@KRBTEST.COM'} at 127.0.0.1:54724:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:16.775863 25624 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Sending DeleteTablet for 3 replicas of tablet df936fe803b14fadaf42b894fbb1664d
I20260807 19:49:16.776997 26065 tablet_service.cc:1514] Processing DeleteTablet for tablet df936fe803b14fadaf42b894fbb1664d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:16 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:50128
I20260807 19:49:16.776981 25842 tablet_service.cc:1514] Processing DeleteTablet for tablet df936fe803b14fadaf42b894fbb1664d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:16 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 19:49:16.777156 26292 tablet_service.cc:1514] Processing DeleteTablet for tablet df936fe803b14fadaf42b894fbb1664d with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:16 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42952
I20260807 19:49:16.788369 26558 tablet_replica.cc:330] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: stopping tablet replica
I20260807 19:49:16.789165 26560 tablet_replica.cc:330] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: stopping tablet replica
I20260807 19:49:16.789397 26559 tablet_replica.cc:330] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: stopping tablet replica
I20260807 19:49:16.789685 26559 raft_consensus.cc:2229] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:16.789834 26560 raft_consensus.cc:2229] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:16.790125 26559 raft_consensus.cc:2258] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:16.790506 26558 raft_consensus.cc:2229] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:16.790731 26560 raft_consensus.cc:2258] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:16.791491 26558 raft_consensus.cc:2258] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:16.791873 26559 ts_tablet_manager.cc:1905] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:16.792861 26560 ts_tablet_manager.cc:1905] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:16.794328 26558 ts_tablet_manager.cc:1905] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:16.800239 26559 ts_tablet_manager.cc:1918] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:49:16.800420 26559 log.cc:1196] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/df936fe803b14fadaf42b894fbb1664d
I20260807 19:49:16.800956 26559 ts_tablet_manager.cc:1939] T df936fe803b14fadaf42b894fbb1664d P 91ec4ee4b7c44707982aff8916776231: Deleting consensus metadata
I20260807 19:49:16.802613 25605 catalog_manager.cc:4841] TS 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257): tablet df936fe803b14fadaf42b894fbb1664d (table test-table [id=d7870f145fa14794a41f01451f7ca1b2]) successfully deleted
I20260807 19:49:16.808552 26558 ts_tablet_manager.cc:1918] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:49:16.808586 26560 ts_tablet_manager.cc:1918] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:49:16.808753 26560 log.cc:1196] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/df936fe803b14fadaf42b894fbb1664d
I20260807 19:49:16.808940 26558 log.cc:1196] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/df936fe803b14fadaf42b894fbb1664d
I20260807 19:49:16.809331 26560 ts_tablet_manager.cc:1939] T df936fe803b14fadaf42b894fbb1664d P d3db2a840c3a4641838d66810194ad5b: Deleting consensus metadata
I20260807 19:49:16.809630 26558 ts_tablet_manager.cc:1939] T df936fe803b14fadaf42b894fbb1664d P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting consensus metadata
I20260807 19:49:16.811091 25600 catalog_manager.cc:4841] TS 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547): tablet df936fe803b14fadaf42b894fbb1664d (table test-table [id=d7870f145fa14794a41f01451f7ca1b2]) successfully deleted
I20260807 19:49:16.811444 25600 catalog_manager.cc:4841] TS d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797): tablet df936fe803b14fadaf42b894fbb1664d (table test-table [id=d7870f145fa14794a41f01451f7ca1b2]) successfully deleted
Aug 07 19:49:16 dist-test-slave-2p8l krb5kdc[25552](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
Aug 07 19:49:16 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:16 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:49:16.879091 26569 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:16.866487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54360 (local address 127.12.155.190:35507)
0807 19:49:16.867551 (+ 1064us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.867557 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.867577 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:49:16.867650 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.867654 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.867731 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.867876 (+ 145us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:16.869526 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.870639 (+ 1113us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.872023 (+ 1384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.872496 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.872651 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.878679 (+ 6028us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:54360: BlockingRecv error: recv got EOF from 127.0.0.1:54360 (error 108)
Metrics: {"server-negotiator.queue_time_us":850,"thread_start_us":642,"threads_started":1}
Aug 07 19:49:16 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM
I20260807 19:49:16.901422 26569 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:16.882921 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54362 (local address 127.12.155.190:35507)
0807 19:49:16.883201 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:16.883207 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:16.883596 (+ 389us) server_negotiation.cc:407] Connection header received
0807 19:49:16.883840 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:16.883844 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:16.883933 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:16.884025 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:16.885822 (+ 1797us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.886709 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.888809 (+ 2100us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:16.889253 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:16.889360 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:16.895074 (+ 5714us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:16.895081 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:16.895084 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:16.895128 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:16.898206 (+ 3078us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:16.899190 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:16.899194 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:16.899197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:16.899383 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:16.899908 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:16.899911 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:16.899913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:16.900224 (+ 311us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:16.900452 (+ 228us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:16.900873 (+ 421us) server_negotiation.cc:299] Negotiation successful
0807 19:49:16.901092 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 19:49:16.906564 25624 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:49:16.907614 25624 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:16.917747 25842 tablet_service.cc:1467] Processing CreateTablet for tablet 53bfd3bf2222413caf3f4150475fceb1 (DEFAULT_TABLE table=test-table [id=4af14b2da6bd459b854473d5f1c1cf11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:16.918412 25842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53bfd3bf2222413caf3f4150475fceb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:16.918469 26292 tablet_service.cc:1467] Processing CreateTablet for tablet 53bfd3bf2222413caf3f4150475fceb1 (DEFAULT_TABLE table=test-table [id=4af14b2da6bd459b854473d5f1c1cf11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:16.919063 26292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53bfd3bf2222413caf3f4150475fceb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:16.920130 26065 tablet_service.cc:1467] Processing CreateTablet for tablet 53bfd3bf2222413caf3f4150475fceb1 (DEFAULT_TABLE table=test-table [id=4af14b2da6bd459b854473d5f1c1cf11]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:16.920722 26065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 53bfd3bf2222413caf3f4150475fceb1. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:16.935194 26579 tablet_bootstrap.cc:492] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Bootstrap starting.
I20260807 19:49:16.937318 26576 tablet_bootstrap.cc:492] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Bootstrap starting.
I20260807 19:49:16.938313 26578 tablet_bootstrap.cc:492] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Bootstrap starting.
I20260807 19:49:16.938030 26579 tablet_bootstrap.cc:654] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:16.940701 26578 tablet_bootstrap.cc:654] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:16.947654 26576 tablet_bootstrap.cc:654] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:16.948693 26579 tablet_bootstrap.cc:492] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: No bootstrap required, opened a new log
I20260807 19:49:16.948933 26579 ts_tablet_manager.cc:1397] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Time spent bootstrapping tablet: real 0.014s user 0.011s sys 0.000s
I20260807 19:49:16.950151 26579 raft_consensus.cc:348] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.950502 26579 raft_consensus.cc:374] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:16.950625 26579 raft_consensus.cc:729] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3db2a840c3a4641838d66810194ad5b, State: Initialized, Role: FOLLOWER
I20260807 19:49:16.950984 26579 consensus_queue.cc:260] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.953527 26579 ts_tablet_manager.cc:1428] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:16.956871 26576 tablet_bootstrap.cc:492] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: No bootstrap required, opened a new log
I20260807 19:49:16.957113 26576 ts_tablet_manager.cc:1397] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent bootstrapping tablet: real 0.020s user 0.002s sys 0.005s
I20260807 19:49:16.958431 26576 raft_consensus.cc:348] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.958786 26576 raft_consensus.cc:374] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:16.958931 26576 raft_consensus.cc:729] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Initialized, Role: FOLLOWER
I20260807 19:49:16.959438 26576 consensus_queue.cc:260] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.960567 26576 ts_tablet_manager.cc:1428] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent starting tablet: real 0.003s user 0.003s sys 0.001s
I20260807 19:49:16.964655 26578 tablet_bootstrap.cc:492] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: No bootstrap required, opened a new log
I20260807 19:49:16.964936 26578 ts_tablet_manager.cc:1397] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Time spent bootstrapping tablet: real 0.029s user 0.005s sys 0.008s
I20260807 19:49:16.966295 26578 raft_consensus.cc:348] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.966588 26578 raft_consensus.cc:374] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:16.966679 26578 raft_consensus.cc:729] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ec4ee4b7c44707982aff8916776231, State: Initialized, Role: FOLLOWER
I20260807 19:49:16.966950 26578 consensus_queue.cc:260] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:16.967583 26578 ts_tablet_manager.cc:1428] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Time spent starting tablet: real 0.002s user 0.001s sys 0.000s
I20260807 19:49:17.366544 26552 raft_consensus.cc:482] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:17.366827 26552 raft_consensus.cc:504] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.367663 26552 leader_election.cc:288] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:17.368468 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53bfd3bf2222413caf3f4150475fceb1" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231" is_pre_election: true
I20260807 19:49:17.368494 26328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53bfd3bf2222413caf3f4150475fceb1" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b" is_pre_election: true
I20260807 19:49:17.368762 26092 raft_consensus.cc:2454] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:17.368952 26328 raft_consensus.cc:2454] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 0.
I20260807 19:49:17.369416 25764 leader_election.cc:302] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231; no voters:
I20260807 19:49:17.369715 26552 raft_consensus.cc:2781] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:17.369812 26552 raft_consensus.cc:482] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:17.369946 26552 raft_consensus.cc:3037] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:17.372318 26552 raft_consensus.cc:504] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.372977 26552 leader_election.cc:288] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Requested vote from peers 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:17.373600 26328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53bfd3bf2222413caf3f4150475fceb1" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b"
I20260807 19:49:17.373618 26092 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "53bfd3bf2222413caf3f4150475fceb1" candidate_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "91ec4ee4b7c44707982aff8916776231"
I20260807 19:49:17.373878 26328 raft_consensus.cc:3037] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:17.373878 26092 raft_consensus.cc:3037] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:17.377277 26092 raft_consensus.cc:2454] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:17.377280 26328 raft_consensus.cc:2454] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5b5bb5247a4249ee9527f4cfa23c4e49 in term 1.
I20260807 19:49:17.377861 25764 leader_election.cc:302] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 5b5bb5247a4249ee9527f4cfa23c4e49, 91ec4ee4b7c44707982aff8916776231, d3db2a840c3a4641838d66810194ad5b; no voters:
I20260807 19:49:17.378227 26552 raft_consensus.cc:2781] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:17.378662 26552 raft_consensus.cc:686] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Becoming Leader. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Running, Role: LEADER
I20260807 19:49:17.379056 26552 consensus_queue.cc:237] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.382774 25623 catalog_manager.cc:5495] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } health_report { overall_health: UNKNOWN } } }
I20260807 19:49:17.404920 26595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.399341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56148 (local address 127.12.155.129:39547)
0807 19:49:17.399977 (+ 636us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:17.399982 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:17.400000 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:49:17.400065 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:17.400069 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:17.400146 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:17.400238 (+ 92us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:17.400613 (+ 375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.401402 (+ 789us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.402900 (+ 1498us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.403402 (+ 502us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.403518 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.403954 (+ 436us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:17.404093 (+ 139us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:17.404198 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:17.404397 (+ 199us) server_negotiation.cc:299] Negotiation successful
0807 19:49:17.404502 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":515,"thread_start_us":329,"threads_started":1}
I20260807 19:49:17.408607 26328 raft_consensus.cc:1261] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Refusing update from remote peer 5b5bb5247a4249ee9527f4cfa23c4e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:17.408646 26092 raft_consensus.cc:1261] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Refusing update from remote peer 5b5bb5247a4249ee9527f4cfa23c4e49: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:17.409374 26586 consensus_queue.cc:1035] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:17.409861 26552 consensus_queue.cc:1035] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:17.424470 25623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:17.424753 25623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:17.428025 25623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Sending DeleteTablet for 3 replicas of tablet 53bfd3bf2222413caf3f4150475fceb1
I20260807 19:49:17.429047 26065 tablet_service.cc:1514] Processing DeleteTablet for tablet 53bfd3bf2222413caf3f4150475fceb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:17 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:50128
I20260807 19:49:17.429096 26292 tablet_service.cc:1514] Processing DeleteTablet for tablet 53bfd3bf2222413caf3f4150475fceb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:17 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42952
I20260807 19:49:17.429625 25842 tablet_service.cc:1514] Processing DeleteTablet for tablet 53bfd3bf2222413caf3f4150475fceb1 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:17 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 19:49:17.430292 26608 tablet_replica.cc:330] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: stopping tablet replica
I20260807 19:49:17.430311 25623 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54362:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20260807 19:49:17.430612 26608 raft_consensus.cc:2229] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:17.430999 26608 raft_consensus.cc:2258] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus is shut down!
W20260807 19:49:17.431057 25623 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:17.431396 26611 tablet_replica.cc:330] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: stopping tablet replica
I20260807 19:49:17.431689 26611 raft_consensus.cc:2229] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:17.432072 26611 raft_consensus.cc:2258] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:17.433538 26608 ts_tablet_manager.cc:1905] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:17.434626 26612 tablet_replica.cc:330] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: stopping tablet replica
I20260807 19:49:17.434888 26612 raft_consensus.cc:2229] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:17.435370 26611 ts_tablet_manager.cc:1905] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:17.435376 26612 raft_consensus.cc:2258] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:17.436630 26612 ts_tablet_manager.cc:1905] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:17.440682 26292 tablet_service.cc:1467] Processing CreateTablet for tablet 9da6056eb07f493286768ea735e6e69a (DEFAULT_TABLE table=test-table [id=1a9d5244ad5744d597f5fc4fc6ab79e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:17.441229 26292 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da6056eb07f493286768ea735e6e69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:17.442215 26608 ts_tablet_manager.cc:1918] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:17.442394 26608 log.cc:1196] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/53bfd3bf2222413caf3f4150475fceb1
I20260807 19:49:17.442914 26608 ts_tablet_manager.cc:1939] T 53bfd3bf2222413caf3f4150475fceb1 P 91ec4ee4b7c44707982aff8916776231: Deleting consensus metadata
I20260807 19:49:17.443684 26611 ts_tablet_manager.cc:1918] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:17.443959 26611 log.cc:1196] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/53bfd3bf2222413caf3f4150475fceb1
I20260807 19:49:17.443967 26612 ts_tablet_manager.cc:1918] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:17.444092 26612 log.cc:1196] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/53bfd3bf2222413caf3f4150475fceb1
I20260807 19:49:17.444283 25605 catalog_manager.cc:4841] TS 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257): tablet 53bfd3bf2222413caf3f4150475fceb1 (table test-table [id=4af14b2da6bd459b854473d5f1c1cf11]) successfully deleted
I20260807 19:49:17.444432 26065 tablet_service.cc:1467] Processing CreateTablet for tablet 9da6056eb07f493286768ea735e6e69a (DEFAULT_TABLE table=test-table [id=1a9d5244ad5744d597f5fc4fc6ab79e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:17.444609 26612 ts_tablet_manager.cc:1939] T 53bfd3bf2222413caf3f4150475fceb1 P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting consensus metadata
I20260807 19:49:17.444800 26611 ts_tablet_manager.cc:1939] T 53bfd3bf2222413caf3f4150475fceb1 P d3db2a840c3a4641838d66810194ad5b: Deleting consensus metadata
I20260807 19:49:17.444886 26065 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da6056eb07f493286768ea735e6e69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:17.445789 25600 catalog_manager.cc:4841] TS 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547): tablet 53bfd3bf2222413caf3f4150475fceb1 (table test-table [id=4af14b2da6bd459b854473d5f1c1cf11]) successfully deleted
I20260807 19:49:17.446120 25600 catalog_manager.cc:4841] TS d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797): tablet 53bfd3bf2222413caf3f4150475fceb1 (table test-table [id=4af14b2da6bd459b854473d5f1c1cf11]) successfully deleted
I20260807 19:49:17.446714 25842 tablet_service.cc:1467] Processing CreateTablet for tablet 9da6056eb07f493286768ea735e6e69a (DEFAULT_TABLE table=test-table [id=1a9d5244ad5744d597f5fc4fc6ab79e3]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:17.447118 25842 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 9da6056eb07f493286768ea735e6e69a. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:17.449451 26579 tablet_bootstrap.cc:492] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Bootstrap starting.
I20260807 19:49:17.451099 26578 tablet_bootstrap.cc:492] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Bootstrap starting.
I20260807 19:49:17.451450 26579 tablet_bootstrap.cc:654] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:17.453047 26578 tablet_bootstrap.cc:654] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:17.453528 26576 tablet_bootstrap.cc:492] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Bootstrap starting.
I20260807 19:49:17.455188 26576 tablet_bootstrap.cc:654] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:17.455394 26579 tablet_bootstrap.cc:492] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: No bootstrap required, opened a new log
I20260807 19:49:17.455392 26578 tablet_bootstrap.cc:492] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: No bootstrap required, opened a new log
I20260807 19:49:17.455576 26578 ts_tablet_manager.cc:1397] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Time spent bootstrapping tablet: real 0.005s user 0.003s sys 0.000s
I20260807 19:49:17.455576 26579 ts_tablet_manager.cc:1397] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Time spent bootstrapping tablet: real 0.006s user 0.004s sys 0.000s
I20260807 19:49:17.456457 26578 raft_consensus.cc:348] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.456456 26579 raft_consensus.cc:348] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.456743 26579 raft_consensus.cc:374] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:17.456830 26579 raft_consensus.cc:729] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d3db2a840c3a4641838d66810194ad5b, State: Initialized, Role: FOLLOWER
I20260807 19:49:17.456749 26578 raft_consensus.cc:374] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:17.456938 26578 raft_consensus.cc:729] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 91ec4ee4b7c44707982aff8916776231, State: Initialized, Role: FOLLOWER
I20260807 19:49:17.457125 26579 consensus_queue.cc:260] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.457273 26578 consensus_queue.cc:260] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.457753 26579 ts_tablet_manager.cc:1428] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Time spent starting tablet: real 0.002s user 0.000s sys 0.000s
I20260807 19:49:17.458972 26578 ts_tablet_manager.cc:1428] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Time spent starting tablet: real 0.003s user 0.003s sys 0.000s
I20260807 19:49:17.459208 26576 tablet_bootstrap.cc:492] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: No bootstrap required, opened a new log
I20260807 19:49:17.459424 26576 ts_tablet_manager.cc:1397] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent bootstrapping tablet: real 0.006s user 0.005s sys 0.000s
I20260807 19:49:17.460341 26576 raft_consensus.cc:348] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.460610 26576 raft_consensus.cc:374] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:17.460691 26576 raft_consensus.cc:729] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b5bb5247a4249ee9527f4cfa23c4e49, State: Initialized, Role: FOLLOWER
I20260807 19:49:17.460956 26576 consensus_queue.cc:260] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.461647 26576 ts_tablet_manager.cc:1428] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Time spent starting tablet: real 0.002s user 0.002s sys 0.001s
I20260807 19:49:17.647257 26542 raft_consensus.cc:482] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:17.647711 26542 raft_consensus.cc:504] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.648618 26542 leader_election.cc:288] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:17.649655 25876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6056eb07f493286768ea735e6e69a" candidate_uuid: "91ec4ee4b7c44707982aff8916776231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" is_pre_election: true
I20260807 19:49:17.649636 26328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6056eb07f493286768ea735e6e69a" candidate_uuid: "91ec4ee4b7c44707982aff8916776231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b" is_pre_election: true
I20260807 19:49:17.649984 25876 raft_consensus.cc:2454] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91ec4ee4b7c44707982aff8916776231 in term 0.
I20260807 19:49:17.650005 26328 raft_consensus.cc:2454] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 91ec4ee4b7c44707982aff8916776231 in term 0.
I20260807 19:49:17.650513 25985 leader_election.cc:302] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91ec4ee4b7c44707982aff8916776231, d3db2a840c3a4641838d66810194ad5b; no voters:
I20260807 19:49:17.650811 26542 raft_consensus.cc:2781] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:17.650986 26542 raft_consensus.cc:482] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:17.651072 26542 raft_consensus.cc:3037] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:17.654276 26542 raft_consensus.cc:504] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.654985 26542 leader_election.cc:288] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [CANDIDATE]: Term 1 election: Requested vote from peers 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547), d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797)
I20260807 19:49:17.655772 25876 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6056eb07f493286768ea735e6e69a" candidate_uuid: "91ec4ee4b7c44707982aff8916776231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49"
I20260807 19:49:17.655807 26328 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9da6056eb07f493286768ea735e6e69a" candidate_uuid: "91ec4ee4b7c44707982aff8916776231" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d3db2a840c3a4641838d66810194ad5b"
I20260807 19:49:17.656085 25876 raft_consensus.cc:3037] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:17.656105 26328 raft_consensus.cc:3037] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:17.659976 25876 raft_consensus.cc:2454] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91ec4ee4b7c44707982aff8916776231 in term 1.
I20260807 19:49:17.659957 26328 raft_consensus.cc:2454] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 91ec4ee4b7c44707982aff8916776231 in term 1.
I20260807 19:49:17.660703 25985 leader_election.cc:302] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 91ec4ee4b7c44707982aff8916776231, d3db2a840c3a4641838d66810194ad5b; no voters:
I20260807 19:49:17.661154 26542 raft_consensus.cc:2781] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:17.661772 26542 raft_consensus.cc:686] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 1 LEADER]: Becoming Leader. State: Replica: 91ec4ee4b7c44707982aff8916776231, State: Running, Role: LEADER
I20260807 19:49:17.662622 26542 consensus_queue.cc:237] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } }
I20260807 19:49:17.667438 25624 catalog_manager.cc:5495] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 reported cstate change: term changed from 0 to 1, leader changed from <none> to 91ec4ee4b7c44707982aff8916776231 (127.12.155.130). New cstate: current_term: 1 leader_uuid: "91ec4ee4b7c44707982aff8916776231" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "91ec4ee4b7c44707982aff8916776231" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35257 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 } health_report { overall_health: UNKNOWN } } }
I20260807 19:49:17.721989 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.714870 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44212 (local address 127.12.155.130:35257)
0807 19:49:17.715875 (+ 1005us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:17.715879 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:17.715900 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:49:17.716071 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:17.716076 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:17.716174 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:17.716386 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:17.716868 (+ 482us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.717739 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.719271 (+ 1532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.719762 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.719910 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.720438 (+ 528us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:17.721252 (+ 814us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:17.721446 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:17.721501 (+ 55us) server_negotiation.cc:299] Negotiation successful
0807 19:49:17.721598 (+ 97us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":870,"thread_start_us":701,"threads_started":1}
I20260807 19:49:17.741066 26595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.735186 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:52661 (local address 127.12.155.129:39547)
0807 19:49:17.735483 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:17.735491 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:17.735896 (+ 405us) server_negotiation.cc:407] Connection header received
0807 19:49:17.736084 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:17.736089 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:17.736176 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:17.736273 (+ 97us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:17.736813 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.737648 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.739252 (+ 1604us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.739769 (+ 517us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.739917 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.740383 (+ 466us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:17.740511 (+ 128us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:17.740586 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:17.740726 (+ 140us) server_negotiation.cc:299] Negotiation successful
0807 19:49:17.740808 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:49:17.741174 26624 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.735025 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:39547 (local address 127.12.155.130:52661)
0807 19:49:17.735781 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:17.735800 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:17.735942 (+ 142us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:17.736295 (+ 353us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:17.736298 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:17.736309 (+ 11us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:49:17.736629 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:17.736638 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.737777 (+ 1139us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.737780 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:17.739105 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:17.739119 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.739970 (+ 851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.739975 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:17.740115 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.740180 (+ 65us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:49:17.740604 (+ 424us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:49:17.740613 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 19:49:17.740680 (+ 67us) client_negotiation.cc:240] Negotiation successful
0807 19:49:17.740794 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":585,"thread_start_us":434,"threads_started":1}
I20260807 19:49:17.751751 26328 raft_consensus.cc:1261] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Refusing update from remote peer 91ec4ee4b7c44707982aff8916776231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:17.752110 25876 raft_consensus.cc:1261] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Refusing update from remote peer 91ec4ee4b7c44707982aff8916776231: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:17.752548 26616 consensus_queue.cc:1035] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d3db2a840c3a4641838d66810194ad5b" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 40797 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:17.753100 26542 consensus_queue.cc:1035] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5b5bb5247a4249ee9527f4cfa23c4e49" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 39547 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:17.785758 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.779230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:33745 (local address 127.12.155.130:35257)
0807 19:49:17.779436 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:17.779443 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:17.780196 (+ 753us) server_negotiation.cc:407] Connection header received
0807 19:49:17.780459 (+ 263us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:17.780464 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:17.780549 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:17.780683 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:17.781249 (+ 566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.782302 (+ 1053us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.783802 (+ 1500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.784263 (+ 461us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.784428 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.784880 (+ 452us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:17.785005 (+ 125us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:17.785110 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:17.785277 (+ 167us) server_negotiation.cc:299] Negotiation successful
0807 19:49:17.785376 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":46}
I20260807 19:49:17.785847 26633 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.779249 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:35257 (local address 127.12.155.129:33745)
0807 19:49:17.780063 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:17.780081 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:17.780265 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:17.780698 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:17.780703 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:17.780717 (+ 14us) client_negotiation.cc:189] Negotiated authn=TOKEN
0807 19:49:17.781091 (+ 374us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:17.781102 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.782441 (+ 1339us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.782451 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:17.783645 (+ 1194us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:17.783658 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.784442 (+ 784us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.784448 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:17.784630 (+ 182us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.784679 (+ 49us) client_negotiation.cc:252] Sending TOKEN_EXCHANGE NegotiatePB request
0807 19:49:17.785111 (+ 432us) client_negotiation.cc:271] Received TOKEN_EXCHANGE NegotiatePB response
0807 19:49:17.785127 (+ 16us) client_negotiation.cc:769] Sending connection context
0807 19:49:17.785248 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 19:49:17.785434 (+ 186us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":615,"thread_start_us":423,"threads_started":1}
I20260807 19:49:17.831605 25623 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:17.831894 25623 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54362:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:17.836066 25623 catalog_manager.cc:5782] T 00000000000000000000000000000000 P e5ee318ef3314c34a978d5b139929406: Sending DeleteTablet for 3 replicas of tablet 9da6056eb07f493286768ea735e6e69a
I20260807 19:49:17.837251 26065 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da6056eb07f493286768ea735e6e69a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:17 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:50128
I20260807 19:49:17.837369 26292 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da6056eb07f493286768ea735e6e69a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:17 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42952
I20260807 19:49:17.837687 26608 tablet_replica.cc:330] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: stopping tablet replica
I20260807 19:49:17.837751 26611 tablet_replica.cc:330] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: stopping tablet replica
I20260807 19:49:17.837970 26611 raft_consensus.cc:2229] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:17.837977 26608 raft_consensus.cc:2229] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:17.838114 25842 tablet_service.cc:1514] Processing DeleteTablet for tablet 9da6056eb07f493286768ea735e6e69a with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:17 UTC) from {username='oryx', principal='oryx/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:51240
I20260807 19:49:17.838249 26611 raft_consensus.cc:2258] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:17.838673 26608 raft_consensus.cc:2258] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:17.839042 26612 tablet_replica.cc:330] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: stopping tablet replica
I20260807 19:49:17.839313 26612 raft_consensus.cc:2229] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:17.839586 26612 raft_consensus.cc:2258] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:17.839967 26611 ts_tablet_manager.cc:1905] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:17.841100 26608 ts_tablet_manager.cc:1905] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:17.842782 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 25734
I20260807 19:49:17.847676 26611 ts_tablet_manager.cc:1918] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:49:17.847738 26612 ts_tablet_manager.cc:1905] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:17.847883 26611 log.cc:1196] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/9da6056eb07f493286768ea735e6e69a
I20260807 19:49:17.848387 26611 ts_tablet_manager.cc:1939] T 9da6056eb07f493286768ea735e6e69a P d3db2a840c3a4641838d66810194ad5b: Deleting consensus metadata
I20260807 19:49:17.849771 25600 catalog_manager.cc:4841] TS d3db2a840c3a4641838d66810194ad5b (127.12.155.131:40797): tablet 9da6056eb07f493286768ea735e6e69a (table test-table [id=1a9d5244ad5744d597f5fc4fc6ab79e3]) successfully deleted
I20260807 19:49:17.853268 26608 ts_tablet_manager.cc:1918] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:49:17.853487 26608 log.cc:1196] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/9da6056eb07f493286768ea735e6e69a
I20260807 19:49:17.854015 26608 ts_tablet_manager.cc:1939] T 9da6056eb07f493286768ea735e6e69a P 91ec4ee4b7c44707982aff8916776231: Deleting consensus metadata
I20260807 19:49:17.855758 25605 catalog_manager.cc:4841] TS 91ec4ee4b7c44707982aff8916776231 (127.12.155.130:35257): tablet 9da6056eb07f493286768ea735e6e69a (table test-table [id=1a9d5244ad5744d597f5fc4fc6ab79e3]) successfully deleted
I20260807 19:49:17.856310 26612 ts_tablet_manager.cc:1918] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.5
I20260807 19:49:17.856571 26612 log.cc:1196] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonDefaultPrincipal.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/9da6056eb07f493286768ea735e6e69a
I20260807 19:49:17.857038 26612 ts_tablet_manager.cc:1939] T 9da6056eb07f493286768ea735e6e69a P 5b5bb5247a4249ee9527f4cfa23c4e49: Deleting consensus metadata
I20260807 19:49:17.858408 25600 catalog_manager.cc:4841] TS 5b5bb5247a4249ee9527f4cfa23c4e49 (127.12.155.129:39547): tablet 9da6056eb07f493286768ea735e6e69a (table test-table [id=1a9d5244ad5744d597f5fc4fc6ab79e3]) successfully deleted
Aug 07 19:49:17 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.129@KRBTEST.COM
I20260807 19:49:17.874567 26595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:17.844344 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56158 (local address 127.12.155.129:39547)
0807 19:49:17.844584 (+ 240us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:17.844592 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:17.856160 (+ 11568us) server_negotiation.cc:407] Connection header received
0807 19:49:17.856478 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:17.856485 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:17.856593 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:17.856722 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:17.858451 (+ 1729us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.859412 (+ 961us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.860878 (+ 1466us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:17.861468 (+ 590us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:17.861616 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:17.866616 (+ 5000us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:17.866646 (+ 30us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:17.866677 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:17.866732 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:17.871102 (+ 4370us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:17.871949 (+ 847us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:17.871962 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:17.871966 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:17.872167 (+ 201us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:17.872556 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:17.872562 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:17.872565 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:17.873152 (+ 587us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:17.873534 (+ 382us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:17.873782 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 19:49:17.874103 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:49:17.875547 25950 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:18.058192 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 25734
I20260807 19:49:18.108026 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 25962
Aug 07 19:49:18 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.130@KRBTEST.COM
I20260807 19:49:18.131143 26621 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:18.109045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44222 (local address 127.12.155.130:35257)
0807 19:49:18.109328 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:18.109338 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:18.109512 (+ 174us) server_negotiation.cc:407] Connection header received
0807 19:49:18.109777 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:18.109783 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:18.109861 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:18.110016 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:18.111658 (+ 1642us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:18.112568 (+ 910us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:18.114022 (+ 1454us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:18.114604 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:18.114780 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:18.124037 (+ 9257us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:18.124051 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:18.124077 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:18.124135 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:18.127804 (+ 3669us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:18.128607 (+ 803us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:18.128617 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:18.128619 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:18.128770 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:18.129221 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:18.129229 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:18.129236 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:18.129683 (+ 447us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:18.130089 (+ 406us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:18.130453 (+ 364us) server_negotiation.cc:299] Negotiation successful
0807 19:49:18.130704 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:49:18.132015 26162 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:18.292759 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 25962
I20260807 19:49:18.329157 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 26176
Aug 07 19:49:18 dist-test-slave-2p8l krb5kdc[25552](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132156, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for oryx/127.12.155.131@KRBTEST.COM
I20260807 19:49:18.348227 26646 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:18.330174 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50484 (local address 127.12.155.131:40797)
0807 19:49:18.330805 (+ 631us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:18.330809 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:18.330829 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:49:18.330902 (+ 73us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:18.330906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:18.330993 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:18.331132 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:18.332627 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:18.333432 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:18.334887 (+ 1455us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:18.335736 (+ 849us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:18.335852 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:18.341131 (+ 5279us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:18.341154 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:18.341179 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:18.341225 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:18.344965 (+ 3740us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:18.345710 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:18.345720 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:18.345723 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:18.345934 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:18.346459 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:18.346463 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:18.346465 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:18.346952 (+ 487us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:18.347244 (+ 292us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:18.347550 (+ 306us) server_negotiation.cc:299] Negotiation successful
0807 19:49:18.347871 (+ 321us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":372,"threads_started":1}
I20260807 19:49:18.349071 26395 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:18.462287 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 26176
I20260807 19:49:18.498405 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 25576
I20260807 19:49:18.500155 25693 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:18.636255 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 25576
2026-08-07T19:49:18Z chronyd exiting
[ OK ] SecurityITest.TestNonDefaultPrincipal (7937 ms)
[ RUN ] SecurityITest.TestNonExistentPrincipal
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:49:18 dist-test-slave-2p8l krb5kdc[26655](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:49:18 dist-test-slave-2p8l krb5kdc[26655](info): set up 2 sockets
Aug 07 19:49:18 dist-test-slave-2p8l krb5kdc[26655](info): commencing operation
krb5kdc: starting...
W20260807 19:49:20.067623 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.366s user 0.006s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:49:20 dist-test-slave-2p8l krb5kdc[26655](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132160, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:49:20Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:20Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:49:20.398037 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40569
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:45661
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--principal=oryx with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:20.831002 26677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:20.831400 26677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:20.831591 26677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:20.840305 26677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:20.840442 26677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:20.840531 26677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:20.840622 26677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:20.840711 26677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:20.851995 26677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:45661
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40569
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=oryx
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestNonExistentPrincipal.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:20.853871 26677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:20.855703 26677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:20.870172 26682 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:20.870117 26685 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:20.870071 26683 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:20.871472 26677 server_base.cc:1034] running on GCE node
I20260807 19:49:20.872545 26677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:20.874480 26677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:20.875736 26677 hybrid_clock.cc:648] HybridClock initialized: now 1786132160875663 us; error 65 us; skew 500 ppm
I20260807 19:49:20.876197 26677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Runtime error: kinit failed: unable to login from keytab: Keytab contains no suitable keys for oryx@KRBTEST.COM
2026-08-07T19:49:20Z chronyd exiting
[ OK ] SecurityITest.TestNonExistentPrincipal (2307 ms)
[ RUN ] SecurityITest.TestMismatchingPrincipals
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:49:21 dist-test-slave-2p8l krb5kdc[26697](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:49:21 dist-test-slave-2p8l krb5kdc[26697](info): set up 2 sockets
Aug 07 19:49:21 dist-test-slave-2p8l krb5kdc[26697](info): commencing operation
krb5kdc: starting...
W20260807 19:49:22.436988 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.428s user 0.008s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:49:22 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:49:22Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:22Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:49:22.786795 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:39253
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:39253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:23.205021 26714 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:23.205461 26714 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:23.205663 26714 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:23.213464 26714 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:23.213644 26714 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:23.213761 26714 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:23.213874 26714 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:23.213973 26714 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:23.225051 26714 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:39253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:39253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:23.226939 26714 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:23.228689 26714 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:23.243068 26720 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:23.243069 26721 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:23.243000 26724 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:23.244318 26714 server_base.cc:1034] running on GCE node
I20260807 19:49:23.245327 26714 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:23.247324 26714 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:23.248553 26714 hybrid_clock.cc:648] HybridClock initialized: now 1786132163248509 us; error 44 us; skew 500 ppm
I20260807 19:49:23.248979 26714 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:23 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:23.257165 26714 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:49:23.259207 26714 webserver.cc:460] Webserver started at http://127.12.155.190:39179/ using document root <none> and password file <none>
I20260807 19:49:23.260120 26714 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:23.260288 26714 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:23.260694 26714 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:23.264436 26714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "ec921110b53644b1858f848fdb781487"
format_stamp: "Formatted at 2026-08-07 19:49:23 on dist-test-slave-2p8l"
server_key: "2b4ae52a9ac239b3bb2d940aacc3ae02"
server_key_iv: "c80131d6d4b71744d2458ff87b41ed49"
server_key_version: "encryptionkey@0"
I20260807 19:49:23.265352 26714 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "ec921110b53644b1858f848fdb781487"
format_stamp: "Formatted at 2026-08-07 19:49:23 on dist-test-slave-2p8l"
server_key: "2b4ae52a9ac239b3bb2d940aacc3ae02"
server_key_iv: "c80131d6d4b71744d2458ff87b41ed49"
server_key_version: "encryptionkey@0"
I20260807 19:49:23.271551 26714 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 19:49:23.275609 26733 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:23.277323 26714 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:49:23.277534 26714 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "ec921110b53644b1858f848fdb781487"
format_stamp: "Formatted at 2026-08-07 19:49:23 on dist-test-slave-2p8l"
server_key: "2b4ae52a9ac239b3bb2d940aacc3ae02"
server_key_iv: "c80131d6d4b71744d2458ff87b41ed49"
server_key_version: "encryptionkey@0"
I20260807 19:49:23.277769 26714 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:23.298244 26714 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:23.303625 26714 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:23.303974 26714 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:23.327054 26714 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:39253
I20260807 19:49:23.327090 26802 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:39253 every 8 connection(s)
I20260807 19:49:23.328904 26714 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:49:23.334299 26803 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:23.334719 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 26714
I20260807 19:49:23.334980 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:49:23.335750 12910 external_mini_cluster.cc:1428] Setting key 0160cf00b0e813999107be2086e98428
I20260807 19:49:23.354833 26803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Bootstrap starting.
Aug 07 19:49:23 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:23.360419 26803 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:23.362043 26803 log.cc:824] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:23.366493 26803 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: No bootstrap required, opened a new log
I20260807 19:49:23.367707 26810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:23.338355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59534 (local address 127.12.155.190:39253)
0807 19:49:23.339491 (+ 1136us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:23.339513 (+ 22us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:23.339586 (+ 73us) server_negotiation.cc:407] Connection header received
0807 19:49:23.343835 (+ 4249us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:23.343879 (+ 44us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:23.344648 (+ 769us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:23.345306 (+ 658us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:23.347203 (+ 1897us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:23.349661 (+ 2458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:23.351178 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:23.352621 (+ 1443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:23.352865 (+ 244us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:23.357742 (+ 4877us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:23.357758 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:23.357785 (+ 27us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:23.357862 (+ 77us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:23.362580 (+ 4718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:23.363511 (+ 931us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:23.363520 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:23.363536 (+ 16us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:23.363759 (+ 223us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:23.364221 (+ 462us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:23.364225 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:23.364227 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:23.364915 (+ 688us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:23.365264 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:23.365775 (+ 511us) server_negotiation.cc:299] Negotiation successful
0807 19:49:23.366336 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":466,"threads_started":1}
I20260807 19:49:23.377280 26803 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:23.377897 26803 raft_consensus.cc:374] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:23.378054 26803 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec921110b53644b1858f848fdb781487, State: Initialized, Role: FOLLOWER
I20260807 19:49:23.379024 26803 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:23.379441 26803 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:49:23.379649 26803 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:49:23.379901 26803 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:23.383255 26803 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:23.384033 26803 leader_election.cc:302] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec921110b53644b1858f848fdb781487; no voters:
I20260807 19:49:23.384922 26803 leader_election.cc:288] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:49:23.385082 26815 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:23.385948 26815 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 LEADER]: Becoming Leader. State: Replica: ec921110b53644b1858f848fdb781487, State: Running, Role: LEADER
I20260807 19:49:23.386559 26815 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:23.387964 26803 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:23.390035 26819 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ec921110b53644b1858f848fdb781487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } } }
I20260807 19:49:23.390666 26819 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:23.390501 26821 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec921110b53644b1858f848fdb781487. Latest consensus state: current_term: 1 leader_uuid: "ec921110b53644b1858f848fdb781487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } } }
I20260807 19:49:23.390841 26821 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:23.391850 26833 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:23.398460 26833 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:23.408777 26833 catalog_manager.cc:1347] Generated new cluster ID: dea354ca3b3b431ea6c29dbb8d8262a8
I20260807 19:49:23.408942 26833 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:23.426278 26833 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:49:23.428164 26833 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:23.442190 26833 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Generated new TSK 0
I20260807 19:49:23.443352 26833 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:49:23.529649 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:39253
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:23.957355 26854 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:23.957751 26854 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:23.957868 26854 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:23.966259 26854 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:23.966404 26854 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:23.966534 26854 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:23.977584 26854 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:23.979449 26854 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:23.981101 26854 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:23.997534 26867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:23.997481 26861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:23.997581 26864 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:23.998641 26854 server_base.cc:1034] running on GCE node
I20260807 19:49:23.999421 26854 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:24.000604 26854 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:24.001991 26854 hybrid_clock.cc:648] HybridClock initialized: now 1786132164001927 us; error 48 us; skew 500 ppm
I20260807 19:49:24.002488 26854 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:23 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:24.006789 26854 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:49:24.008970 26854 webserver.cc:460] Webserver started at http://127.12.155.129:41853/ using document root <none> and password file <none>
I20260807 19:49:24.009933 26854 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:24.010138 26854 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:24.010542 26854 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:24.014394 26854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "8d729d07ad8e4c69b9baa2ec3943d358"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "732f89dcc3120d29f6ef3cc9eb98a33b"
server_key_iv: "00b8e08a467e39ca0bc39bc282aa238a"
server_key_version: "encryptionkey@0"
I20260807 19:49:24.015398 26854 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "8d729d07ad8e4c69b9baa2ec3943d358"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "732f89dcc3120d29f6ef3cc9eb98a33b"
server_key_iv: "00b8e08a467e39ca0bc39bc282aa238a"
server_key_version: "encryptionkey@0"
I20260807 19:49:24.022383 26854 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260807 19:49:24.026932 26879 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:24.028767 26854 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:24.029013 26854 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "8d729d07ad8e4c69b9baa2ec3943d358"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "732f89dcc3120d29f6ef3cc9eb98a33b"
server_key_iv: "00b8e08a467e39ca0bc39bc282aa238a"
server_key_version: "encryptionkey@0"
I20260807 19:49:24.029269 26854 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:24.058704 26854 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:24.064393 26854 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:24.064814 26854 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:24.066164 26854 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:24.067921 26854 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:24.068041 26854 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:24.068210 26854 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:24.068290 26854 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:24.108878 26854 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:41297
I20260807 19:49:24.108989 27044 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:41297 every 8 connection(s)
I20260807 19:49:24.110641 26854 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:24.118652 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 26854
I20260807 19:49:24.118955 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:49:24.119710 12910 external_mini_cluster.cc:1428] Setting key 5905a3f6e9382703dcc516e3c1b28911
Aug 07 19:49:24 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132163, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:24.137319 27047 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:24.114225 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:38231 (local address 127.12.155.190:39253)
0807 19:49:24.114796 (+ 571us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:24.114802 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:24.116077 (+ 1275us) server_negotiation.cc:407] Connection header received
0807 19:49:24.118342 (+ 2265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:24.118349 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:24.118470 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:24.118606 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:24.120712 (+ 2106us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.121696 (+ 984us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.123620 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.124444 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.124638 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:24.128982 (+ 4344us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:24.128992 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:24.129000 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:24.129057 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:24.133309 (+ 4252us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:24.134391 (+ 1082us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:24.134400 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:24.134406 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:24.134643 (+ 237us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:24.135139 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:24.135147 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:24.135152 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:24.135644 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:24.135818 (+ 174us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:24.136691 (+ 873us) server_negotiation.cc:299] Negotiation successful
0807 19:49:24.136968 (+ 277us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":421,"thread_start_us":275,"threads_started":1}
I20260807 19:49:24.139153 27048 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:24.115021 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:38231)
0807 19:49:24.115884 (+ 863us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:24.115931 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:24.117943 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:24.118936 (+ 993us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:24.118947 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:24.119633 (+ 686us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:24.120449 (+ 816us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:24.120481 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.121944 (+ 1463us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.121950 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:24.123441 (+ 1491us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:24.123461 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.124706 (+ 1245us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.124710 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:24.124949 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:24.125801 (+ 852us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:24.125827 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:24.128713 (+ 2886us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:24.133544 (+ 4831us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:24.133555 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:24.133577 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:24.134238 (+ 661us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:24.134770 (+ 532us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:24.134774 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:24.134777 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:24.135014 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:24.135777 (+ 763us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:24.135784 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:24.136224 (+ 440us) client_negotiation.cc:769] Sending connection context
0807 19:49:24.136515 (+ 291us) client_negotiation.cc:240] Negotiation successful
0807 19:49:24.137240 (+ 725us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":339,"threads_started":1}
I20260807 19:49:24.141281 27045 heartbeater.cc:347] Connected to a master server at 127.12.155.190:39253
I20260807 19:49:24.141752 27045 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:24.142855 27045 heartbeater.cc:511] Master 127.12.155.190:39253 requested a full tablet report, sending...
I20260807 19:49:24.145908 26762 ts_manager.cc:194] Registered new tserver with Master: 8d729d07ad8e4c69b9baa2ec3943d358 (127.12.155.129:41297)
I20260807 19:49:24.147751 26762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:38231
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:49:24.197440 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:39253
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:24.611424 27051 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:24.611889 27051 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:24.612003 27051 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:24.620116 27051 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:24.620278 27051 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:24.620409 27051 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:24.631584 27051 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:24.633481 27051 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:24.635368 27051 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:24.652069 27062 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:24.652160 27064 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:24.651993 27061 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:24.658874 27051 server_base.cc:1034] running on GCE node
I20260807 19:49:24.659900 27051 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:24.661273 27051 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:24.662544 27051 hybrid_clock.cc:648] HybridClock initialized: now 1786132164662487 us; error 56 us; skew 500 ppm
I20260807 19:49:24.662972 27051 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:24 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132164, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:24.667078 27051 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:49:24.669060 27051 webserver.cc:460] Webserver started at http://127.12.155.130:38997/ using document root <none> and password file <none>
I20260807 19:49:24.669998 27051 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:24.670194 27051 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:24.670596 27051 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:24.674410 27051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "bbb53a71a3a24dfc8ad6d2928f037ba1"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "78cbb6db92e2456ebd7f35ffb77be5c6"
server_key_iv: "2dbdebd07f9dcbe5be1be7ca5c771f7a"
server_key_version: "encryptionkey@0"
I20260807 19:49:24.675333 27051 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "bbb53a71a3a24dfc8ad6d2928f037ba1"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "78cbb6db92e2456ebd7f35ffb77be5c6"
server_key_iv: "2dbdebd07f9dcbe5be1be7ca5c771f7a"
server_key_version: "encryptionkey@0"
I20260807 19:49:24.681524 27051 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:49:24.686138 27071 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:24.687912 27051 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260807 19:49:24.688130 27051 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "bbb53a71a3a24dfc8ad6d2928f037ba1"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "78cbb6db92e2456ebd7f35ffb77be5c6"
server_key_iv: "2dbdebd07f9dcbe5be1be7ca5c771f7a"
server_key_version: "encryptionkey@0"
I20260807 19:49:24.688417 27051 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:24.739365 27051 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:24.744835 27051 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:24.745218 27051 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:24.746579 27051 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:24.748346 27051 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:24.748469 27051 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:24.748637 27051 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:24.748718 27051 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:24.789162 27051 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34009
I20260807 19:49:24.789209 27252 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34009 every 8 connection(s)
I20260807 19:49:24.790987 27051 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:24.795637 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 27051
I20260807 19:49:24.795908 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:49:24.796608 12910 external_mini_cluster.cc:1428] Setting key 52e19cf1b8c86f4497551fd59d51cfec
Aug 07 19:49:24 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132164, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:24.817395 27257 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:24.794585 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:60537 (local address 127.12.155.190:39253)
0807 19:49:24.795230 (+ 645us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:24.795235 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:24.796616 (+ 1381us) server_negotiation.cc:407] Connection header received
0807 19:49:24.799085 (+ 2469us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:24.799090 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:24.799206 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:24.799348 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:24.801125 (+ 1777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.801933 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.803659 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.804127 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.804268 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:24.808479 (+ 4211us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:24.808485 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:24.808489 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:24.808532 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:24.812993 (+ 4461us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:24.814106 (+ 1113us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:24.814115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:24.814119 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:24.814289 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:24.814939 (+ 650us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:24.814944 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:24.814947 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:24.815372 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:24.815540 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:24.816704 (+ 1164us) server_negotiation.cc:299] Negotiation successful
0807 19:49:24.817027 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":518,"thread_start_us":359,"threads_started":1}
I20260807 19:49:24.819316 27258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:24.795278 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:60537)
0807 19:49:24.796420 (+ 1142us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:24.796465 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:24.798755 (+ 2290us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:24.799616 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:24.799625 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:24.800250 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:24.800945 (+ 695us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:24.800964 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.802130 (+ 1166us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.802135 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:24.803499 (+ 1364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:24.803513 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:24.804386 (+ 873us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:24.804394 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:24.804681 (+ 287us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:24.805540 (+ 859us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:24.805566 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:24.808184 (+ 2618us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:24.813223 (+ 5039us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:24.813235 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:24.813258 (+ 23us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:24.813887 (+ 629us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:24.814426 (+ 539us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:24.814434 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:24.814440 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:24.814761 (+ 321us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:24.815536 (+ 775us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:24.815550 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:24.816179 (+ 629us) client_negotiation.cc:769] Sending connection context
0807 19:49:24.816567 (+ 388us) client_negotiation.cc:240] Negotiation successful
0807 19:49:24.817370 (+ 803us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"thread_start_us":527,"threads_started":1}
I20260807 19:49:24.821313 27253 heartbeater.cc:347] Connected to a master server at 127.12.155.190:39253
I20260807 19:49:24.821744 27253 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:24.822770 27253 heartbeater.cc:511] Master 127.12.155.190:39253 requested a full tablet report, sending...
I20260807 19:49:24.824663 26762 ts_manager.cc:194] Registered new tserver with Master: bbb53a71a3a24dfc8ad6d2928f037ba1 (127.12.155.130:34009)
I20260807 19:49:24.825659 26762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:60537
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:49:24.873641 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:39253
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:25.152041 27045 heartbeater.cc:503] Master 127.12.155.190:39253 was elected leader, sending a full tablet report...
W20260807 19:49:25.313534 27261 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:25.313905 27261 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:25.314142 27261 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:25.322188 27261 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:25.322309 27261 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:25.322535 27261 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:25.333436 27261 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:25.335455 27261 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:25.337141 27261 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:25.353003 27266 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:25.353183 27270 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:25.353256 27267 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:25.354805 27261 server_base.cc:1034] running on GCE node
I20260807 19:49:25.355603 27261 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:25.356869 27261 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:25.358163 27261 hybrid_clock.cc:648] HybridClock initialized: now 1786132165358081 us; error 77 us; skew 500 ppm
I20260807 19:49:25.358552 27261 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:25 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132165, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:25.362607 27261 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:49:25.364565 27261 webserver.cc:460] Webserver started at http://127.12.155.131:38007/ using document root <none> and password file <none>
I20260807 19:49:25.365461 27261 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:25.365602 27261 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:25.365993 27261 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:25.370267 27261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "d77e6ea64a184aeb97644fe915fbbce4"
format_stamp: "Formatted at 2026-08-07 19:49:25 on dist-test-slave-2p8l"
server_key: "e039b89e8729f80ad4e949c8543a3383"
server_key_iv: "a970e4179a5d3ad6331b309645c15b4a"
server_key_version: "encryptionkey@0"
I20260807 19:49:25.371150 27261 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "d77e6ea64a184aeb97644fe915fbbce4"
format_stamp: "Formatted at 2026-08-07 19:49:25 on dist-test-slave-2p8l"
server_key: "e039b89e8729f80ad4e949c8543a3383"
server_key_iv: "a970e4179a5d3ad6331b309645c15b4a"
server_key_version: "encryptionkey@0"
I20260807 19:49:25.377282 27261 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:49:25.381474 27280 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:25.383287 27261 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:49:25.383509 27261 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "d77e6ea64a184aeb97644fe915fbbce4"
format_stamp: "Formatted at 2026-08-07 19:49:25 on dist-test-slave-2p8l"
server_key: "e039b89e8729f80ad4e949c8543a3383"
server_key_iv: "a970e4179a5d3ad6331b309645c15b4a"
server_key_version: "encryptionkey@0"
I20260807 19:49:25.383754 27261 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:25.401886 27261 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:25.407238 27261 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:25.407624 27261 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:25.408892 27261 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:25.410660 27261 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:25.410776 27261 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:25.410953 27261 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:25.411031 27261 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:25.450769 27261 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:40941
I20260807 19:49:25.450829 27462 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:40941 every 8 connection(s)
I20260807 19:49:25.452528 27261 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:25.453780 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 27261
I20260807 19:49:25.454015 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:49:25.454771 12910 external_mini_cluster.cc:1428] Setting key ca1392b4ad03d220fec363e27e1019a9
Aug 07 19:49:25 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132165, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:25.479142 27466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:25.456231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:49873 (local address 127.12.155.190:39253)
0807 19:49:25.456952 (+ 721us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:25.456958 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:25.458571 (+ 1613us) server_negotiation.cc:407] Connection header received
0807 19:49:25.460947 (+ 2376us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:25.460952 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:25.461053 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:25.461158 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:25.463362 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.464322 (+ 960us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.466396 (+ 2074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.466932 (+ 536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.467050 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:25.471960 (+ 4910us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:25.471968 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:25.471976 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:25.472043 (+ 67us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:25.475444 (+ 3401us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:25.476365 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:25.476371 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:25.476374 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:25.476552 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:25.477055 (+ 503us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:25.477060 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:25.477062 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:25.477434 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:25.477594 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:25.478560 (+ 966us) server_negotiation.cc:299] Negotiation successful
0807 19:49:25.478786 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":544,"thread_start_us":325,"threads_started":1}
I20260807 19:49:25.480392 27467 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:25.457146 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:49873)
0807 19:49:25.458348 (+ 1202us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:25.458415 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:25.460615 (+ 2200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:25.461479 (+ 864us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:25.461490 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:25.462323 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:25.463155 (+ 832us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:25.463177 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.464528 (+ 1351us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.464534 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:25.466199 (+ 1665us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:25.466216 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.467230 (+ 1014us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.467236 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:25.467543 (+ 307us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:25.468487 (+ 944us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:25.468518 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:25.471584 (+ 3066us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:25.475609 (+ 4025us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:25.475618 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:25.475639 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:25.476186 (+ 547us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:25.476669 (+ 483us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:25.476672 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:25.476675 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:25.476912 (+ 237us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:25.477563 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:25.477571 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:25.478020 (+ 449us) client_negotiation.cc:769] Sending connection context
0807 19:49:25.478403 (+ 383us) client_negotiation.cc:240] Negotiation successful
0807 19:49:25.478932 (+ 529us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":760,"thread_start_us":413,"threads_started":1}
I20260807 19:49:25.482187 27463 heartbeater.cc:347] Connected to a master server at 127.12.155.190:39253
I20260807 19:49:25.482590 27463 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:25.483686 27463 heartbeater.cc:511] Master 127.12.155.190:39253 requested a full tablet report, sending...
I20260807 19:49:25.485648 26762 ts_manager.cc:194] Registered new tserver with Master: d77e6ea64a184aeb97644fe915fbbce4 (127.12.155.131:40941)
I20260807 19:49:25.486642 26762 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:49873
I20260807 19:49:25.498263 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
WARNING: no policy specified for oryx/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab.
Entry for principal oryx/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab.
WARNING: no policy specified for oryx/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab.
Entry for principal oryx/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab.
WARNING: no policy specified for oryx/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "oryx/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal oryx/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab.
Entry for principal oryx/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab.
I20260807 19:49:25.710254 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 26854
Aug 07 19:49:25 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:49:25.731680 27479 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:25.711975 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50796 (local address 127.12.155.129:41297)
0807 19:49:25.712974 (+ 999us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:25.712989 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:25.713308 (+ 319us) server_negotiation.cc:407] Connection header received
0807 19:49:25.713601 (+ 293us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:25.713611 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:25.713947 (+ 336us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:25.714190 (+ 243us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:25.715786 (+ 1596us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.716947 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.718470 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.719130 (+ 660us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.719287 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:25.724433 (+ 5146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:25.724449 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:25.724481 (+ 32us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:25.724532 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:25.728452 (+ 3920us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:25.729216 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:25.729226 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:25.729228 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:25.729394 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:25.729785 (+ 391us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:25.729790 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:25.729793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:25.730421 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:25.730799 (+ 378us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:25.731004 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 19:49:25.731285 (+ 281us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":732,"thread_start_us":452,"threads_started":1}
I20260807 19:49:25.733376 27039 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:25.827255 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 26854
I20260807 19:49:25.831626 27253 heartbeater.cc:503] Master 127.12.155.190:39253 was elected leader, sending a full tablet report...
I20260807 19:49:25.858935 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27051
Aug 07 19:49:25 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:49:25.878587 27481 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:25.860108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43490 (local address 127.12.155.130:34009)
0807 19:49:25.860822 (+ 714us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:25.860831 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:25.860863 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:49:25.860947 (+ 84us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:25.860956 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:25.861223 (+ 267us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:25.861456 (+ 233us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:25.863119 (+ 1663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.864263 (+ 1144us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.865670 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:25.866435 (+ 765us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:25.866588 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:25.871522 (+ 4934us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:25.871538 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:25.871560 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:25.871607 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:25.875207 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:25.876023 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:25.876032 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:25.876035 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:25.876201 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:25.876621 (+ 420us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:25.876625 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:25.876627 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:25.877190 (+ 563us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:25.877525 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:25.877855 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 19:49:25.878221 (+ 366us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":528,"thread_start_us":350,"threads_started":1}
I20260807 19:49:25.880354 27247 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:25.972218 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 27051
I20260807 19:49:26.004565 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27261
Aug 07 19:49:26 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132162, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:49:26.024778 27483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:26.005852 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37452 (local address 127.12.155.131:40941)
0807 19:49:26.006611 (+ 759us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:26.006620 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:26.006653 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:49:26.006732 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:26.006740 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:26.007048 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:26.007215 (+ 167us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:26.008749 (+ 1534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:26.009981 (+ 1232us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:26.011475 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:26.012097 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:26.012213 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:26.017966 (+ 5753us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:26.017983 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:26.018006 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:26.018055 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:26.021487 (+ 3432us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:26.022478 (+ 991us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:26.022488 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:26.022490 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:26.022633 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:26.023075 (+ 442us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:26.023078 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:26.023081 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:26.023491 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:26.023764 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:26.024164 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 19:49:26.024415 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":592,"thread_start_us":417,"threads_started":1}
I20260807 19:49:26.026750 27457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:26.141476 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 27261
I20260807 19:49:26.169623 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 26714
I20260807 19:49:26.171538 26797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:26.297000 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 26714
I20260807 19:49:26.334367 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:39253
--webserver_interface=127.12.155.190
--webserver_port=39179
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:39253
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:26.752803 27487 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:26.753233 27487 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:26.753413 27487 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:26.762488 27487 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:26.762655 27487 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:26.762748 27487 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:26.762853 27487 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:26.762954 27487 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:26.774694 27487 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:39253
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:39253
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=39179
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:26.776652 27487 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:26.778627 27487 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:26.793295 27494 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:26.793409 27495 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:26.793350 27499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:26.794667 27487 server_base.cc:1034] running on GCE node
I20260807 19:49:26.795692 27487 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:26.797595 27487 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:26.798837 27487 hybrid_clock.cc:648] HybridClock initialized: now 1786132166798770 us; error 56 us; skew 500 ppm
I20260807 19:49:26.799242 27487 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:26 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132166, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:26.803222 27487 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:49:26.805212 27487 webserver.cc:460] Webserver started at http://127.12.155.190:39179/ using document root <none> and password file <none>
I20260807 19:49:26.806218 27487 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:26.806407 27487 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:26.814574 27487 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:49:26.818892 27512 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:26.820683 27487 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:26.820921 27487 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "ec921110b53644b1858f848fdb781487"
format_stamp: "Formatted at 2026-08-07 19:49:23 on dist-test-slave-2p8l"
server_key: "2b4ae52a9ac239b3bb2d940aacc3ae02"
server_key_iv: "c80131d6d4b71744d2458ff87b41ed49"
server_key_version: "encryptionkey@0"
I20260807 19:49:26.822315 27487 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:26.863349 27487 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:26.869099 27487 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:26.869516 27487 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:26.893524 27487 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:39253
I20260807 19:49:26.893546 27600 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:39253 every 8 connection(s)
I20260807 19:49:26.895583 27487 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:49:26.902436 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 27487
I20260807 19:49:26.903644 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:41297
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:39253
--webserver_port=41853
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:26.904821 27601 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:49:26.910681 27601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Bootstrap starting.
I20260807 19:49:26.937668 27601 log.cc:824] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:26.949656 27601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:49:26.950403 27601 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Bootstrap complete.
I20260807 19:49:26.961750 27601 raft_consensus.cc:348] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:26.962809 27601 raft_consensus.cc:729] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: ec921110b53644b1858f848fdb781487, State: Initialized, Role: FOLLOWER
I20260807 19:49:26.963748 27601 consensus_queue.cc:260] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:26.964046 27601 raft_consensus.cc:388] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:49:26.964184 27601 raft_consensus.cc:482] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:49:26.964404 27601 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:49:26.969061 27601 raft_consensus.cc:504] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:26.969677 27601 leader_election.cc:302] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ec921110b53644b1858f848fdb781487; no voters:
I20260807 19:49:26.970499 27601 leader_election.cc:288] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:49:26.970675 27607 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:49:26.972167 27607 raft_consensus.cc:686] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [term 2 LEADER]: Becoming Leader. State: Replica: ec921110b53644b1858f848fdb781487, State: Running, Role: LEADER
I20260807 19:49:26.972852 27607 consensus_queue.cc:237] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } }
I20260807 19:49:26.973248 27601 sys_catalog.cc:564] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:26.976354 27610 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: SysCatalogTable state changed. Reason: New leader ec921110b53644b1858f848fdb781487. Latest consensus state: current_term: 2 leader_uuid: "ec921110b53644b1858f848fdb781487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } } }
I20260807 19:49:26.976888 27610 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:26.977622 27609 sys_catalog.cc:455] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "ec921110b53644b1858f848fdb781487" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ec921110b53644b1858f848fdb781487" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 39253 } } }
I20260807 19:49:26.978036 27609 sys_catalog.cc:458] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:26.991882 27617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:26.998622 27617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:27.000253 27617 catalog_manager.cc:1259] Loaded cluster ID: dea354ca3b3b431ea6c29dbb8d8262a8
I20260807 19:49:27.000401 27617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:27.004948 27617 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:27.006590 27617 catalog_manager.cc:5879] T 00000000000000000000000000000000 P ec921110b53644b1858f848fdb781487: Loaded TSK: 0
I20260807 19:49:27.008389 27617 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 19:49:27.336853 27604 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:27.337304 27604 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:27.337486 27604 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:27.345754 27604 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:27.345969 27604 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:27.346195 27604 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:27.357839 27604 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.129.keytab
--principal=oryx/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:41297
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=41853
--tserver_master_addrs=127.12.155.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:27.359793 27604 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:27.361557 27604 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:27.378343 27634 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:27.378399 27639 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:27.378424 27635 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:27.379387 27604 server_base.cc:1034] running on GCE node
I20260807 19:49:27.380136 27604 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:27.381418 27604 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:27.382648 27604 hybrid_clock.cc:648] HybridClock initialized: now 1786132167382591 us; error 51 us; skew 500 ppm
I20260807 19:49:27.383138 27604 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132167, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:27.387207 27604 init.cc:377] Logged in from keytab as oryx/127.12.155.129@KRBTEST.COM (short username oryx)
I20260807 19:49:27.389415 27604 webserver.cc:460] Webserver started at http://127.12.155.129:41853/ using document root <none> and password file <none>
I20260807 19:49:27.390456 27604 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:27.390637 27604 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:27.397490 27604 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.001s
I20260807 19:49:27.400755 27652 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:27.402624 27604 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:49:27.402863 27604 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "8d729d07ad8e4c69b9baa2ec3943d358"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "732f89dcc3120d29f6ef3cc9eb98a33b"
server_key_iv: "00b8e08a467e39ca0bc39bc282aa238a"
server_key_version: "encryptionkey@0"
I20260807 19:49:27.404189 27604 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:27.434743 27604 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:27.440675 27604 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:27.441073 27604 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:27.442478 27604 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:27.444239 27604 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:27.444416 27604 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:27.444562 27604 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:27.444636 27604 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:27.485236 27604 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:41297
I20260807 19:49:27.485266 27823 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:41297 every 8 connection(s)
I20260807 19:49:27.487110 27604 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:27.496028 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 27604
I20260807 19:49:27.496865 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:34009
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:39253
--webserver_port=38997
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:49:27.509869 27827 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:27.491233 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:34595 (local address 127.12.155.190:39253)
0807 19:49:27.492108 (+ 875us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:27.492122 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:27.492542 (+ 420us) server_negotiation.cc:407] Connection header received
0807 19:49:27.495058 (+ 2516us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:27.495071 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:27.495496 (+ 425us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:27.495909 (+ 413us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:27.497836 (+ 1927us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.499214 (+ 1378us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.500909 (+ 1695us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.501591 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.501833 (+ 242us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:27.508529 (+ 6696us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:34595: BlockingRecv error: recv got EOF from 127.12.155.129:34595 (error 108)
Metrics: {"server-negotiator.queue_time_us":616,"thread_start_us":293,"threads_started":1}
I20260807 19:49:27.509887 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:27.491288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:34595)
0807 19:49:27.492288 (+ 1000us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:27.492341 (+ 53us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:27.494469 (+ 2128us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:27.496075 (+ 1606us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:27.496087 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:27.496860 (+ 773us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:27.497591 (+ 731us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:27.497611 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.499410 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.499415 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:27.500735 (+ 1320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:27.500749 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.501877 (+ 1128us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.501884 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:27.502197 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:27.503124 (+ 927us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:27.503160 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:27.508100 (+ 4940us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":677,"thread_start_us":430,"threads_started":1}
W20260807 19:49:27.510855 27824 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:39253 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.155.190:39253: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:27.521639 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:27.511695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:41995)
0807 19:49:27.511982 (+ 287us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:27.512001 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:27.512108 (+ 107us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:27.512500 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:27.512503 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:27.512899 (+ 396us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:27.513070 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:27.513080 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.514746 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.514751 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:27.515676 (+ 925us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:27.515690 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.516750 (+ 1060us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.516754 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:27.516922 (+ 168us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:27.517662 (+ 740us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:27.517682 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:27.521387 (+ 3705us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":128}
W20260807 19:49:27.522109 27827 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:27.511856 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:41995 (local address 127.12.155.190:39253)
0807 19:49:27.512115 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:27.512124 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:27.512178 (+ 54us) server_negotiation.cc:407] Connection header received
0807 19:49:27.512253 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:27.512261 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:27.512360 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:27.512466 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:27.513243 (+ 777us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.514574 (+ 1331us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.515838 (+ 1264us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.516595 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.516747 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:27.521729 (+ 4982us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:41995: BlockingRecv error: recv got EOF from 127.12.155.129:41995 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:27.532984 27828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:27.522628 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:36695)
0807 19:49:27.522849 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:27.522874 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:27.523010 (+ 136us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:27.523412 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:27.523419 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:27.523864 (+ 445us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:27.524128 (+ 264us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:27.524142 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.525333 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.525341 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:27.527223 (+ 1882us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:27.527237 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.528428 (+ 1191us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.528433 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:27.528570 (+ 137us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:27.529291 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:27.529311 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:27.532695 (+ 3384us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 19:49:27.533416 27827 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:27.522757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:36695 (local address 127.12.155.190:39253)
0807 19:49:27.522925 (+ 168us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:27.522930 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:27.522946 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:49:27.523154 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:27.523158 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:27.523227 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:27.523331 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:27.524297 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.525161 (+ 864us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.527367 (+ 2206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:27.528251 (+ 884us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:27.528433 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:27.533059 (+ 4626us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:36695: BlockingRecv error: recv got EOF from 127.12.155.129:36695 (error 108)
Metrics: {"server-negotiator.queue_time_us":65}
W20260807 19:49:27.533425 27824 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:49:27.919209 27829 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:27.919571 27829 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:27.919680 27829 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:27.928042 27829 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:27.928205 27829 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:27.928428 27829 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:27.939723 27829 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.130.keytab
--principal=oryx/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:34009
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=38997
--tserver_master_addrs=127.12.155.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:27.941851 27829 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:27.943710 27829 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:27.960223 27835 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:27.960168 27838 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:27.960129 27836 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:27.963706 27829 server_base.cc:1034] running on GCE node
I20260807 19:49:27.964592 27829 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:27.965900 27829 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:27.967170 27829 hybrid_clock.cc:648] HybridClock initialized: now 1786132167967106 us; error 69 us; skew 500 ppm
I20260807 19:49:27.967585 27829 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:27 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132167, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:27.971488 27829 init.cc:377] Logged in from keytab as oryx/127.12.155.130@KRBTEST.COM (short username oryx)
I20260807 19:49:27.973695 27829 webserver.cc:460] Webserver started at http://127.12.155.130:38997/ using document root <none> and password file <none>
I20260807 19:49:27.974789 27829 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:27.974984 27829 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:27.981873 27829 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.006s sys 0.001s
I20260807 19:49:27.985368 27848 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:27.987356 27829 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:49:27.987596 27829 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "bbb53a71a3a24dfc8ad6d2928f037ba1"
format_stamp: "Formatted at 2026-08-07 19:49:24 on dist-test-slave-2p8l"
server_key: "78cbb6db92e2456ebd7f35ffb77be5c6"
server_key_iv: "2dbdebd07f9dcbe5be1be7ca5c771f7a"
server_key_version: "encryptionkey@0"
I20260807 19:49:27.988965 27829 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:28.021044 27829 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:28.026007 27829 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:28.026393 27829 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:28.027704 27829 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:28.029428 27829 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:28.029560 27829 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:28.029706 27829 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:28.029806 27829 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:28.068899 27829 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34009
I20260807 19:49:28.068950 28018 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34009 every 8 connection(s)
I20260807 19:49:28.070770 27829 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:28.080389 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 27829
I20260807 19:49:28.081442 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:40941
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:39253
--webserver_port=38007
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40329
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--principal=oryx/127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:49:28.092259 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.074142 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:45889 (local address 127.12.155.190:39253)
0807 19:49:28.074710 (+ 568us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.074716 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.075943 (+ 1227us) server_negotiation.cc:407] Connection header received
0807 19:49:28.078339 (+ 2396us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.078346 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.078463 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.078613 (+ 150us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.081329 (+ 2716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.082686 (+ 1357us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.084777 (+ 2091us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.085557 (+ 780us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.085747 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.091819 (+ 6072us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:45889: BlockingRecv error: recv got EOF from 127.12.155.130:45889 (error 108)
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":258,"threads_started":1}
I20260807 19:49:28.092826 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.074928 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:45889)
0807 19:49:28.075744 (+ 816us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.075798 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.077932 (+ 2134us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.078920 (+ 988us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.078930 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.079904 (+ 974us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.081052 (+ 1148us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.081087 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.083001 (+ 1914us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.083009 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.084601 (+ 1592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.084615 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.085834 (+ 1219us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.085847 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.086137 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.087061 (+ 924us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.087089 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.091470 (+ 4381us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":531,"thread_start_us":314,"threads_started":1}
W20260807 19:49:28.093696 28019 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:39253 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.155.190:39253: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:28.105446 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.094587 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:50545)
0807 19:49:28.094812 (+ 225us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.094871 (+ 59us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.094977 (+ 106us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.095610 (+ 633us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.095614 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.096036 (+ 422us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.096207 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.096216 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.097630 (+ 1414us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.097638 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.099490 (+ 1852us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.099511 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.100355 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.100365 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.100603 (+ 238us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.101372 (+ 769us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.101402 (+ 30us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.105186 (+ 3784us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 19:49:28.105852 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.095021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:50545 (local address 127.12.155.190:39253)
0807 19:49:28.095252 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.095260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.095281 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:49:28.095349 (+ 68us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.095355 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.095454 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.095567 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.096373 (+ 806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.097465 (+ 1092us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.099669 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.100172 (+ 503us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.100281 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.105522 (+ 5241us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:50545: BlockingRecv error: recv got EOF from 127.12.155.130:50545 (error 108)
Metrics: {"server-negotiator.queue_time_us":62}
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:28.116706 28023 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.106411 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:49511)
0807 19:49:28.106624 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.106648 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.106770 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.107191 (+ 421us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.107199 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.107658 (+ 459us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.107908 (+ 250us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.107923 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.109257 (+ 1334us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.109265 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.111152 (+ 1887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.111172 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.112066 (+ 894us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.112072 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.112308 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.113106 (+ 798us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.113127 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.116341 (+ 3214us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 19:49:28.116930 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.106537 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:49511 (local address 127.12.155.190:39253)
0807 19:49:28.106870 (+ 333us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.106875 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.106895 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:49:28.106956 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.106960 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.107041 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.107140 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.108082 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.109104 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.111328 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.111865 (+ 537us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.112070 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.116597 (+ 4527us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:49511: BlockingRecv error: recv got EOF from 127.12.155.130:49511 (error 108)
Metrics: {"server-negotiator.queue_time_us":69}
W20260807 19:49:28.117167 28019 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:49:28.504241 28025 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:28.504680 28025 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:28.504873 28025 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:28.512893 28025 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:28.513072 28025 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:28.513278 28025 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:28.524179 28025 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40329
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/krb5kdc/oryx_127.12.155.131.keytab
--principal=oryx/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:40941
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=38007
--tserver_master_addrs=127.12.155.190:39253
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:28.526232 28025 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:28.528187 28025 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:28.545559 28037 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:28.545596 28040 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:28.545953 28038 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:28.546963 28025 server_base.cc:1034] running on GCE node
I20260807 19:49:28.547688 28025 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:28.548959 28025 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:28.550186 28025 hybrid_clock.cc:648] HybridClock initialized: now 1786132168550105 us; error 70 us; skew 500 ppm
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:28.550595 28025 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:28.553416 28032 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.534466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:45019)
0807 19:49:28.535174 (+ 708us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.535193 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.535408 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.535831 (+ 423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.535836 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.536428 (+ 592us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.536792 (+ 364us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.536811 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.538752 (+ 1941us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.538761 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.540431 (+ 1670us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.540449 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.541318 (+ 869us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.541324 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.541522 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.548751 (+ 7229us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.548792 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.553020 (+ 4228us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":574,"thread_start_us":421,"threads_started":1}
W20260807 19:49:28.553653 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.534563 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:45019 (local address 127.12.155.190:39253)
0807 19:49:28.534827 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.534836 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.535327 (+ 491us) server_negotiation.cc:407] Connection header received
0807 19:49:28.535573 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.535577 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.535662 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.535787 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.537007 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.538543 (+ 1536us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.540605 (+ 2062us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.541099 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.541209 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.553359 (+ 12150us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:45019: BlockingRecv error: recv got EOF from 127.12.155.129:45019 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132168, etypes {rep=17 tkt=17 ses=17}, oryx/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:28.554999 28025 init.cc:377] Logged in from keytab as oryx/127.12.155.131@KRBTEST.COM (short username oryx)
I20260807 19:49:28.556792 28025 webserver.cc:460] Webserver started at http://127.12.155.131:38007/ using document root <none> and password file <none>
I20260807 19:49:28.557686 28025 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:28.557868 28025 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:28.564922 28025 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:49:28.568316 28048 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:28.570262 28025 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:49:28.570499 28025 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "d77e6ea64a184aeb97644fe915fbbce4"
format_stamp: "Formatted at 2026-08-07 19:49:25 on dist-test-slave-2p8l"
server_key: "e039b89e8729f80ad4e949c8543a3383"
server_key_iv: "a970e4179a5d3ad6331b309645c15b4a"
server_key_version: "encryptionkey@0"
I20260807 19:49:28.571751 28025 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:28.596293 28025 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:28.601565 28025 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:28.601925 28025 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:28.603228 28025 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:28.604911 28025 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:28.605034 28025 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:28.605199 28025 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:28.605427 28025 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:28.644225 28025 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:40941
I20260807 19:49:28.644279 28232 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:40941 every 8 connection(s)
I20260807 19:49:28.646361 28025 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestMismatchingPrincipals.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:28.655320 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 28025
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
W20260807 19:49:28.668334 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.649814 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:48987 (local address 127.12.155.190:39253)
0807 19:49:28.650120 (+ 306us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.650129 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.651481 (+ 1352us) server_negotiation.cc:407] Connection header received
0807 19:49:28.653578 (+ 2097us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.653583 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.653669 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.653769 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.656197 (+ 2428us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.657739 (+ 1542us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.660612 (+ 2873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.661427 (+ 815us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.661590 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.667942 (+ 6352us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:48987: BlockingRecv error: recv got EOF from 127.12.155.131:48987 (error 108)
Metrics: {"mutex_wait_us":41,"server-negotiator.queue_time_us":97}
I20260807 19:49:28.669112 28237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.650334 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:48987)
0807 19:49:28.651264 (+ 930us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.651325 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.653274 (+ 1949us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.654144 (+ 870us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.654155 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.654959 (+ 804us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.655952 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.655990 (+ 38us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.657950 (+ 1960us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.657955 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.660408 (+ 2453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.660427 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.661701 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.661706 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.661983 (+ 277us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.662931 (+ 948us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.662971 (+ 40us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.667638 (+ 4667us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":625,"thread_start_us":389,"threads_started":1}
W20260807 19:49:28.670186 28233 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:39253 (0 consecutive failures): Not authorized: Failed to ping master at 127.12.155.190:39253: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
I20260807 19:49:28.675926 28238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.656579 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57928 (local address 127.12.155.190:39253)
0807 19:49:28.657404 (+ 825us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.657408 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.657963 (+ 555us) server_negotiation.cc:407] Connection header received
0807 19:49:28.658185 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.658189 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.658259 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.658351 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.660612 (+ 2261us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.661881 (+ 1269us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.663892 (+ 2011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.664319 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.664427 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.667618 (+ 3191us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:28.667633 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:28.667664 (+ 31us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:28.667715 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:28.672035 (+ 4320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:28.672836 (+ 801us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:28.672848 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:28.672856 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:28.673070 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:28.673549 (+ 479us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:28.673553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:28.673556 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:28.674178 (+ 622us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:28.674597 (+ 419us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:28.675097 (+ 500us) server_negotiation.cc:299] Negotiation successful
0807 19:49:28.675575 (+ 478us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":684,"thread_start_us":517,"threads_started":1}
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:28.680065 28237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.671081 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:59401)
0807 19:49:28.671325 (+ 244us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.671350 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.671470 (+ 120us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.671830 (+ 360us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.671835 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.672216 (+ 381us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.672387 (+ 171us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.672395 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.673549 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.673555 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.674668 (+ 1113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.674681 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.675434 (+ 753us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.675441 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.675635 (+ 194us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.676246 (+ 611us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.676265 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.679744 (+ 3479us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 19:49:28.680295 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.671171 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:59401 (local address 127.12.155.190:39253)
0807 19:49:28.671446 (+ 275us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.671452 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.671470 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:49:28.671615 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.671621 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.671693 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.671815 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.672533 (+ 718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.673410 (+ 877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.674824 (+ 1414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.675272 (+ 448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.675406 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.680011 (+ 4605us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:59401: BlockingRecv error: recv got EOF from 127.12.155.131:59401 (error 108)
Metrics: {"server-negotiator.queue_time_us":141}
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:28 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:28.688938 28237 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:28.681022 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:51601)
0807 19:49:28.681194 (+ 172us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:28.681211 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:28.681301 (+ 90us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:28.681571 (+ 270us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:28.681574 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:28.681862 (+ 288us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:28.682032 (+ 170us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.682040 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.683103 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.683107 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.684081 (+ 974us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:28.684092 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.684891 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.684896 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:28.685050 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.685645 (+ 595us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:28.685663 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:28.688674 (+ 3011us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":64}
W20260807 19:49:28.689225 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:28.681115 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:51601 (local address 127.12.155.190:39253)
0807 19:49:28.681272 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:28.681276 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:28.681291 (+ 15us) server_negotiation.cc:407] Connection header received
0807 19:49:28.681393 (+ 102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:28.681397 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:28.681454 (+ 57us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:28.681530 (+ 76us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:28.682211 (+ 681us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.682967 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.684233 (+ 1266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:28.684731 (+ 498us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:28.684846 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:28.688909 (+ 4063us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:51601: BlockingRecv error: recv got EOF from 127.12.155.131:51601 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 19:49:28.689425 28233 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
Aug 07 19:49:29 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:29 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:29.128422 28240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:29.118015 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:46961)
0807 19:49:29.118742 (+ 727us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:29.118760 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:29.118906 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:29.119336 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:29.119339 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:29.119938 (+ 599us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:29.120176 (+ 238us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:29.120187 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.121375 (+ 1188us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.121386 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:29.122465 (+ 1079us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:29.122480 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.123302 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.123307 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:29.123460 (+ 153us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:29.124188 (+ 728us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:29.124210 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:29.128122 (+ 3912us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":584,"thread_start_us":375,"threads_started":1}
W20260807 19:49:29.128628 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:29.118041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:46961 (local address 127.12.155.190:39253)
0807 19:49:29.118301 (+ 260us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:29.118306 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:29.118849 (+ 543us) server_negotiation.cc:407] Connection header received
0807 19:49:29.119083 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:29.119088 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:29.119176 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:29.119287 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:29.120361 (+ 1074us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.121232 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.122628 (+ 1396us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.123124 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.123231 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:29.128377 (+ 5146us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:46961: BlockingRecv error: recv got EOF from 127.12.155.130:46961 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
Aug 07 19:49:29 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:29 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:29.564558 28241 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:29.554843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:35135)
0807 19:49:29.555581 (+ 738us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:29.555599 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:29.555758 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:29.556110 (+ 352us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:29.556114 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:29.556649 (+ 535us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:29.556863 (+ 214us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:29.556874 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.558003 (+ 1129us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.558007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:29.559294 (+ 1287us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:29.559310 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.560041 (+ 731us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.560046 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:29.560168 (+ 122us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:29.560901 (+ 733us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:29.560921 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:29.564252 (+ 3331us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":607,"thread_start_us":417,"threads_started":1}
W20260807 19:49:29.564834 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:29.554874 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:35135 (local address 127.12.155.190:39253)
0807 19:49:29.555098 (+ 224us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:29.555103 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:29.555688 (+ 585us) server_negotiation.cc:407] Connection header received
0807 19:49:29.555875 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:29.555879 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:29.555969 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:29.556055 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:29.557020 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.557864 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.559452 (+ 1588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.559892 (+ 440us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.559999 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:29.564528 (+ 4529us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:35135: BlockingRecv error: recv got EOF from 127.12.155.129:35135 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 19:49:29 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:29 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:29.701468 28243 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:29.690407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:48871)
0807 19:49:29.691132 (+ 725us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:29.691153 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:29.691316 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:29.691706 (+ 390us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:29.691710 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:29.692375 (+ 665us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:29.692720 (+ 345us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:29.692747 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.694116 (+ 1369us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.694122 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:29.695861 (+ 1739us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:29.695876 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.696652 (+ 776us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.696657 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:29.696863 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:29.697698 (+ 835us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:29.697720 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:29.701069 (+ 3349us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":583,"thread_start_us":422,"threads_started":1}
W20260807 19:49:29.701563 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:29.690462 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:48871 (local address 127.12.155.190:39253)
0807 19:49:29.690744 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:29.690755 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:29.691256 (+ 501us) server_negotiation.cc:407] Connection header received
0807 19:49:29.691446 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:29.691451 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:29.691529 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:29.691625 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:29.692916 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.693902 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.695998 (+ 2096us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:29.696473 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:29.696580 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:29.701308 (+ 4728us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:48871: BlockingRecv error: recv got EOF from 127.12.155.131:48871 (error 108)
Metrics: {"server-negotiator.queue_time_us":83}
Aug 07 19:49:30 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:30 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:30.139837 28245 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:30.129759 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:59767)
0807 19:49:30.130520 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:30.130539 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:30.130741 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:30.131172 (+ 431us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:30.131177 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:30.131699 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:30.131924 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:30.131960 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.133165 (+ 1205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.133171 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:30.134208 (+ 1037us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:30.134222 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.135054 (+ 832us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.135061 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:30.135253 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:30.136010 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:30.136031 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:30.139430 (+ 3399us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":635,"thread_start_us":410,"threads_started":1}
W20260807 19:49:30.140025 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:30.129813 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:59767 (local address 127.12.155.190:39253)
0807 19:49:30.130103 (+ 290us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:30.130114 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:30.130648 (+ 534us) server_negotiation.cc:407] Connection header received
0807 19:49:30.130894 (+ 246us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:30.130900 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:30.130987 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:30.131105 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:30.132121 (+ 1016us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.132996 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.134365 (+ 1369us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.134861 (+ 496us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.135009 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:30.139701 (+ 4692us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:59767: BlockingRecv error: recv got EOF from 127.12.155.130:59767 (error 108)
Metrics: {"server-negotiator.queue_time_us":85}
Aug 07 19:49:30 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:30 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:30.576455 28246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:30.565927 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:46953)
0807 19:49:30.566777 (+ 850us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:30.566805 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:30.567000 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:30.567501 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:30.567506 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:30.568106 (+ 600us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:30.568409 (+ 303us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:30.568421 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.569535 (+ 1114us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.569539 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:30.570607 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:30.570620 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.571353 (+ 733us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.571357 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:30.571504 (+ 147us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:30.572264 (+ 760us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:30.572283 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:30.575934 (+ 3651us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":489,"threads_started":1}
W20260807 19:49:30.576669 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:30.566286 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:46953 (local address 127.12.155.190:39253)
0807 19:49:30.566567 (+ 281us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:30.566574 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:30.566924 (+ 350us) server_negotiation.cc:407] Connection header received
0807 19:49:30.567135 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:30.567140 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:30.567265 (+ 125us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:30.567403 (+ 138us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:30.568563 (+ 1160us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.569387 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.570740 (+ 1353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.571210 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.571311 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:30.576275 (+ 4964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:46953: BlockingRecv error: recv got EOF from 127.12.155.129:46953 (error 108)
Metrics: {"server-negotiator.queue_time_us":112}
Aug 07 19:49:30 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:30 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:30.713083 28250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:30.702681 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:49715)
0807 19:49:30.703454 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:30.703473 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:30.703630 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:30.704003 (+ 373us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:30.704007 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:30.704547 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:30.704772 (+ 225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:30.704782 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.705937 (+ 1155us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.705942 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:30.706942 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:30.706956 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.707716 (+ 760us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.707720 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:30.707923 (+ 203us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:30.708830 (+ 907us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:30.708893 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:30.712774 (+ 3881us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":624,"thread_start_us":450,"threads_started":1}
W20260807 19:49:30.713425 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:30.702766 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:49715 (local address 127.12.155.190:39253)
0807 19:49:30.702998 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:30.703003 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:30.703562 (+ 559us) server_negotiation.cc:407] Connection header received
0807 19:49:30.703754 (+ 192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:30.703760 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:30.703850 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:30.703945 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:30.704926 (+ 981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.705786 (+ 860us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.707090 (+ 1304us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:30.707563 (+ 473us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:30.707674 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:30.713101 (+ 5427us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:49715: BlockingRecv error: recv got EOF from 127.12.155.131:49715 (error 108)
Metrics: {"server-negotiator.queue_time_us":87}
Aug 07 19:49:31 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:31 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:31.152004 28252 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:31.141267 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:38431)
0807 19:49:31.141965 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:31.141984 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:31.142225 (+ 241us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:31.142617 (+ 392us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:31.142623 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:31.143105 (+ 482us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:31.143348 (+ 243us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:31.143360 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.144525 (+ 1165us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.144533 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:31.145514 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:31.145527 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.146390 (+ 863us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.146396 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:31.146602 (+ 206us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:31.147389 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:31.147410 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:31.151666 (+ 4256us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":573,"thread_start_us":369,"threads_started":1}
W20260807 19:49:31.152180 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:31.141364 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:38431 (local address 127.12.155.190:39253)
0807 19:49:31.141669 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:31.141679 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:31.142091 (+ 412us) server_negotiation.cc:407] Connection header received
0807 19:49:31.142386 (+ 295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:31.142391 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:31.142467 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:31.142581 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:31.143523 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.144354 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.145668 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.146225 (+ 557us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.146363 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:31.151923 (+ 5560us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:38431: BlockingRecv error: recv got EOF from 127.12.155.130:38431 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 19:49:31 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:31 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:31.588001 28253 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:31.578122 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:45619)
0807 19:49:31.578746 (+ 624us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:31.578765 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:31.578930 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:31.579321 (+ 391us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:31.579324 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:31.579777 (+ 453us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:31.579975 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:31.579985 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.581259 (+ 1274us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.581263 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:31.582322 (+ 1059us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:31.582335 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.583153 (+ 818us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.583158 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:31.583296 (+ 138us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:31.584075 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:31.584094 (+ 19us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:31.587629 (+ 3535us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":492,"thread_start_us":333,"threads_started":1}
W20260807 19:49:31.588418 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:31.578153 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:45619 (local address 127.12.155.190:39253)
0807 19:49:31.578415 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:31.578427 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:31.578865 (+ 438us) server_negotiation.cc:407] Connection header received
0807 19:49:31.579050 (+ 185us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:31.579054 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:31.579164 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:31.579266 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:31.580167 (+ 901us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.581120 (+ 953us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.582469 (+ 1349us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.582990 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.583107 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:31.588059 (+ 4952us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:45619: BlockingRecv error: recv got EOF from 127.12.155.129:45619 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
Aug 07 19:49:31 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:31 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:31.725212 28254 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:31.714406 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:47375)
0807 19:49:31.715143 (+ 737us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:31.715162 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:31.715377 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:31.715775 (+ 398us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:31.715780 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:31.716279 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:31.716499 (+ 220us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:31.716509 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.717657 (+ 1148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.717666 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:31.718697 (+ 1031us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:31.718711 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.719535 (+ 824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.719542 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:31.719752 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:31.720559 (+ 807us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:31.720581 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:31.724634 (+ 4053us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":603,"thread_start_us":391,"threads_started":1}
W20260807 19:49:31.725308 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:31.714567 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:47375 (local address 127.12.155.190:39253)
0807 19:49:31.714938 (+ 371us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:31.714945 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:31.715268 (+ 323us) server_negotiation.cc:407] Connection header received
0807 19:49:31.715529 (+ 261us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:31.715539 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:31.715614 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:31.715739 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:31.716668 (+ 929us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.717495 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.718865 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:31.719352 (+ 487us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:31.719509 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:31.724945 (+ 5436us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:47375: BlockingRecv error: recv got EOF from 127.12.155.131:47375 (error 108)
Metrics: {"server-negotiator.queue_time_us":115}
Aug 07 19:49:32 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:32 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:32.166224 28255 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:32.153437 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:41331)
0807 19:49:32.154031 (+ 594us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:32.154050 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:32.154221 (+ 171us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:32.154623 (+ 402us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:32.154627 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:32.155149 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:32.155359 (+ 210us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:32.155369 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.156555 (+ 1186us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.156559 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:32.157613 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:32.157626 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.158592 (+ 966us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.158598 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:32.158808 (+ 210us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:32.159581 (+ 773us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:32.159628 (+ 47us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:32.165684 (+ 6056us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":463,"thread_start_us":323,"threads_started":1}
W20260807 19:49:32.166481 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:32.153543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:41331 (local address 127.12.155.190:39253)
0807 19:49:32.153856 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:32.153863 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:32.154156 (+ 293us) server_negotiation.cc:407] Connection header received
0807 19:49:32.154343 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:32.154347 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:32.154423 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:32.154510 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:32.155506 (+ 996us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.156404 (+ 898us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.157911 (+ 1507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.158417 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.158572 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:32.166103 (+ 7531us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:41331: BlockingRecv error: recv got EOF from 127.12.155.130:41331 (error 108)
Metrics: {"server-negotiator.queue_time_us":95}
Aug 07 19:49:32 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:32 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:32.600049 28256 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:32.589569 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:52397)
0807 19:49:32.590346 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:32.590373 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:32.590569 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:32.591001 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:32.591007 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:32.591731 (+ 724us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:32.591964 (+ 233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:32.591977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.593429 (+ 1452us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.593434 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:32.594670 (+ 1236us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:32.594686 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.595522 (+ 836us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.595526 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:32.595710 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:32.596423 (+ 713us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:32.596444 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:32.599741 (+ 3297us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":600,"thread_start_us":340,"threads_started":1}
W20260807 19:49:32.600482 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:32.589740 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:52397 (local address 127.12.155.190:39253)
0807 19:49:32.590019 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:32.590027 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:32.590499 (+ 472us) server_negotiation.cc:407] Connection header received
0807 19:49:32.590718 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:32.590722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:32.590816 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:32.590925 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:32.592195 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.593283 (+ 1088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.594826 (+ 1543us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.595380 (+ 554us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.595495 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:32.600016 (+ 4521us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:52397: BlockingRecv error: recv got EOF from 127.12.155.129:52397 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 19:49:32 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:32 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:32.737632 28258 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:32.726747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:59713)
0807 19:49:32.727412 (+ 665us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:32.727432 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:32.727589 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:32.728067 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:32.728071 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:32.728615 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:32.728812 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:32.728823 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.730212 (+ 1389us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.730216 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:32.731278 (+ 1062us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:32.731292 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.732200 (+ 908us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.732207 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:32.732451 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:32.733356 (+ 905us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:32.733385 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:32.737345 (+ 3960us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":505,"thread_start_us":372,"threads_started":1}
W20260807 19:49:32.738109 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:32.726837 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:59713 (local address 127.12.155.190:39253)
0807 19:49:32.727113 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:32.727120 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:32.727523 (+ 403us) server_negotiation.cc:407] Connection header received
0807 19:49:32.727790 (+ 267us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:32.727796 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:32.727884 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:32.728058 (+ 174us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:32.728997 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.730016 (+ 1019us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.731442 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:32.731991 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:32.732166 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:32.737657 (+ 5491us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:59713: BlockingRecv error: recv got EOF from 127.12.155.131:59713 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
Aug 07 19:49:33 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:33 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:33.178879 28259 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:33.167754 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:52113)
0807 19:49:33.168503 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:33.168523 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:33.168682 (+ 159us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:33.169151 (+ 469us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:33.169155 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:33.169679 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:33.169968 (+ 289us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:33.169982 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.171420 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.171425 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:33.172434 (+ 1009us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:33.172448 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.173633 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.173641 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:33.173878 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:33.174836 (+ 958us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:33.174856 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:33.178567 (+ 3711us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":595,"thread_start_us":332,"threads_started":1}
W20260807 19:49:33.179287 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:33.167949 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:52113 (local address 127.12.155.190:39253)
0807 19:49:33.168223 (+ 274us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:33.168229 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:33.168652 (+ 423us) server_negotiation.cc:407] Connection header received
0807 19:49:33.168879 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:33.168883 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:33.168988 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:33.169101 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:33.170190 (+ 1089us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.171233 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.172594 (+ 1361us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.173448 (+ 854us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.173600 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:33.178927 (+ 5327us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:52113: BlockingRecv error: recv got EOF from 127.12.155.130:52113 (error 108)
Metrics: {"server-negotiator.queue_time_us":91}
Aug 07 19:49:33 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:33 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:33.615525 28260 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:33.601188 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:41201)
0807 19:49:33.601852 (+ 664us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:33.601871 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:33.602021 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:33.602461 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:33.602465 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:33.602966 (+ 501us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:33.603166 (+ 200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:33.603176 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.604287 (+ 1111us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.604291 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:33.605268 (+ 977us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:33.605282 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.606027 (+ 745us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.606032 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:33.606269 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:33.611239 (+ 4970us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:33.611267 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:33.615229 (+ 3962us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":381,"threads_started":1}
W20260807 19:49:33.615804 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:33.601296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:41201 (local address 127.12.155.190:39253)
0807 19:49:33.601607 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:33.601616 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:33.601970 (+ 354us) server_negotiation.cc:407] Connection header received
0807 19:49:33.602203 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:33.602207 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:33.602312 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:33.602405 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:33.603312 (+ 907us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.604147 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.605418 (+ 1271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.605877 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.605992 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:33.615506 (+ 9514us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:41201: BlockingRecv error: recv got EOF from 127.12.155.129:41201 (error 108)
Metrics: {"server-negotiator.queue_time_us":108}
Aug 07 19:49:33 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:33 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:33.749836 28261 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:33.739167 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:54611)
0807 19:49:33.740153 (+ 986us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:33.740171 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:33.740373 (+ 202us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:33.740805 (+ 432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:33.740811 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:33.741351 (+ 540us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:33.741547 (+ 196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:33.741557 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.742773 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.742783 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:33.743999 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:33.744017 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.744928 (+ 911us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.744934 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:33.745121 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:33.745915 (+ 794us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:33.745936 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:33.749489 (+ 3553us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":856,"thread_start_us":659,"threads_started":1}
W20260807 19:49:33.750036 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:33.739412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:54611 (local address 127.12.155.190:39253)
0807 19:49:33.739669 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:33.739680 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:33.740281 (+ 601us) server_negotiation.cc:407] Connection header received
0807 19:49:33.740543 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:33.740555 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:33.740633 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:33.740753 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:33.741701 (+ 948us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.742597 (+ 896us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.744168 (+ 1571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:33.744735 (+ 567us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:33.744898 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:33.749797 (+ 4899us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:54611: BlockingRecv error: recv got EOF from 127.12.155.131:54611 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 19:49:34 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:34 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:34.190893 28262 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:34.180179 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:39581)
0807 19:49:34.180901 (+ 722us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:34.180921 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:34.181084 (+ 163us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:34.181590 (+ 506us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:34.181594 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:34.182208 (+ 614us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:34.182423 (+ 215us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:34.182435 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.183620 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.183624 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:34.184693 (+ 1069us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:34.184706 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.185589 (+ 883us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.185594 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:34.185751 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:34.186611 (+ 860us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:34.186633 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:34.190594 (+ 3961us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":594,"thread_start_us":397,"threads_started":1}
W20260807 19:49:34.191246 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:34.180241 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:39581 (local address 127.12.155.190:39253)
0807 19:49:34.180504 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:34.180514 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:34.181044 (+ 530us) server_negotiation.cc:407] Connection header received
0807 19:49:34.181281 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:34.181288 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:34.181378 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:34.181506 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:34.182599 (+ 1093us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.183474 (+ 875us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.184876 (+ 1402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.185407 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.185522 (+ 115us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:34.190876 (+ 5354us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:39581: BlockingRecv error: recv got EOF from 127.12.155.130:39581 (error 108)
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 19:49:34 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:34 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:34.627240 28263 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:34.616934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:57613)
0807 19:49:34.617846 (+ 912us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:34.617867 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:34.618029 (+ 162us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:34.618507 (+ 478us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:34.618515 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:34.619088 (+ 573us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:34.619319 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:34.619330 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.620415 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.620419 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:34.621492 (+ 1073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:34.621505 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.622311 (+ 806us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.622316 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:34.622456 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:34.623267 (+ 811us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:34.623290 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:34.626777 (+ 3487us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":723,"thread_start_us":404,"threads_started":1}
W20260807 19:49:34.627312 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:34.617002 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:57613 (local address 127.12.155.190:39253)
0807 19:49:34.617267 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:34.617275 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:34.617972 (+ 697us) server_negotiation.cc:407] Connection header received
0807 19:49:34.618181 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:34.618187 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:34.618303 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:34.618399 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:34.619463 (+ 1064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.620261 (+ 798us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.621634 (+ 1373us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.622140 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.622252 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:34.627026 (+ 4774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:57613: BlockingRecv error: recv got EOF from 127.12.155.129:57613 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
Aug 07 19:49:34 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:34 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:34.762633 28264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:34.751178 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:60869)
0807 19:49:34.751936 (+ 758us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:34.751957 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:34.752105 (+ 148us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:34.752483 (+ 378us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:34.752487 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:34.753049 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:34.753246 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:34.753257 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.754541 (+ 1284us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.754546 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:34.755564 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:34.755578 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.756513 (+ 935us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.756525 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:34.756865 (+ 340us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:34.757951 (+ 1086us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:34.757976 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:34.762299 (+ 4323us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":606,"thread_start_us":429,"threads_started":1}
W20260807 19:49:34.762857 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:34.751372 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:60869 (local address 127.12.155.190:39253)
0807 19:49:34.751611 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:34.751616 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:34.752079 (+ 463us) server_negotiation.cc:407] Connection header received
0807 19:49:34.752227 (+ 148us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:34.752233 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:34.752315 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:34.752412 (+ 97us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:34.753420 (+ 1008us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.754396 (+ 976us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.755706 (+ 1310us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:34.756165 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:34.756370 (+ 205us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:34.762562 (+ 6192us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:60869: BlockingRecv error: recv got EOF from 127.12.155.131:60869 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 19:49:35 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:35 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:35.202631 28266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:35.192109 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:33003)
0807 19:49:35.192825 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:35.192844 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:35.193043 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:35.193511 (+ 468us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:35.193517 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:35.194184 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:35.194416 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:35.194429 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.195766 (+ 1337us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.195779 (+ 13us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:35.196798 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:35.196811 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.197614 (+ 803us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.197620 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:35.197803 (+ 183us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:35.198569 (+ 766us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:35.198590 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:35.202329 (+ 3739us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":305,"threads_started":1}
W20260807 19:49:35.203119 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:35.192199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:33003 (local address 127.12.155.190:39253)
0807 19:49:35.192526 (+ 327us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:35.192535 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:35.192957 (+ 422us) server_negotiation.cc:407] Connection header received
0807 19:49:35.193190 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:35.193198 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:35.193298 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:35.193407 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:35.194580 (+ 1173us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.195567 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.196961 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.197428 (+ 467us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.197568 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:35.202697 (+ 5129us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:33003: BlockingRecv error: recv got EOF from 127.12.155.130:33003 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 07 19:49:35 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:35 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:35.638773 28269 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:35.628478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:51435)
0807 19:49:35.629168 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:35.629196 (+ 28us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:35.629397 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:35.629785 (+ 388us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:35.629791 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:35.630363 (+ 572us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:35.630560 (+ 197us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:35.630569 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.631716 (+ 1147us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.631723 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:35.632777 (+ 1054us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:35.632792 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.633645 (+ 853us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.633651 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:35.633842 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:35.634659 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:35.634683 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:35.638330 (+ 3647us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":516,"thread_start_us":322,"threads_started":1}
W20260807 19:49:35.638921 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:35.628587 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51435 (local address 127.12.155.190:39253)
0807 19:49:35.628844 (+ 257us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:35.628852 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:35.629310 (+ 458us) server_negotiation.cc:407] Connection header received
0807 19:49:35.629542 (+ 232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:35.629548 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:35.629629 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:35.629752 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:35.630716 (+ 964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.631562 (+ 846us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.632932 (+ 1370us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.633439 (+ 507us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.633577 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:35.638604 (+ 5027us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:51435: BlockingRecv error: recv got EOF from 127.12.155.129:51435 (error 108)
Metrics: {"server-negotiator.queue_time_us":64}
Aug 07 19:49:35 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:35 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:35.774991 28270 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:35.763976 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:60849)
0807 19:49:35.764812 (+ 836us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:35.764834 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:35.765021 (+ 187us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:35.765438 (+ 417us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:35.765442 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:35.766144 (+ 702us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:35.766401 (+ 257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:35.766411 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.767627 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.767632 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:35.768811 (+ 1179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:35.768826 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.769646 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.769651 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:35.769842 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:35.770730 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:35.770751 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:35.774568 (+ 3817us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":651,"thread_start_us":390,"threads_started":1}
W20260807 19:49:35.775055 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:35.764134 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:60849 (local address 127.12.155.190:39253)
0807 19:49:35.764432 (+ 298us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:35.764444 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:35.764940 (+ 496us) server_negotiation.cc:407] Connection header received
0807 19:49:35.765167 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:35.765171 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:35.765247 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:35.765334 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:35.766556 (+ 1222us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.767458 (+ 902us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.769039 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:35.769468 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:35.769575 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:35.774835 (+ 5260us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:60849: BlockingRecv error: recv got EOF from 127.12.155.131:60849 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 19:49:36 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:36 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:36.214803 28271 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:36.203933 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:33615)
0807 19:49:36.204611 (+ 678us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:36.204630 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:36.204826 (+ 196us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:36.205203 (+ 377us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:36.205208 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:36.205793 (+ 585us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:36.205984 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:36.205994 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.207461 (+ 1467us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.207467 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:36.208709 (+ 1242us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:36.208727 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.209813 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.209821 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:36.210432 (+ 611us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:36.211190 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:36.211210 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:36.214516 (+ 3306us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":330,"threads_started":1}
W20260807 19:49:36.215014 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:36.204060 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:33615 (local address 127.12.155.190:39253)
0807 19:49:36.204372 (+ 312us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:36.204379 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:36.204736 (+ 357us) server_negotiation.cc:407] Connection header received
0807 19:49:36.204973 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:36.204977 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:36.205057 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:36.205169 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:36.206208 (+ 1039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.207307 (+ 1099us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.208873 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.209563 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.209720 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:36.214736 (+ 5016us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:33615: BlockingRecv error: recv got EOF from 127.12.155.130:33615 (error 108)
Metrics: {"server-negotiator.queue_time_us":109}
Aug 07 19:49:36 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:36 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:36.651572 28272 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:36.640356 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:40019)
0807 19:49:36.641225 (+ 869us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:36.641276 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:36.641491 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:36.642110 (+ 619us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:36.642115 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:36.642676 (+ 561us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:36.642888 (+ 212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:36.642900 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.644082 (+ 1182us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.644088 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:36.645615 (+ 1527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:36.645631 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.646598 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.646605 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:36.646796 (+ 191us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:36.647647 (+ 851us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:36.647674 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:36.651278 (+ 3604us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":720,"thread_start_us":448,"threads_started":1}
W20260807 19:49:36.651981 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:36.640493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:40019 (local address 127.12.155.190:39253)
0807 19:49:36.640963 (+ 470us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:36.640974 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:36.641423 (+ 449us) server_negotiation.cc:407] Connection header received
0807 19:49:36.641715 (+ 292us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:36.641722 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:36.641897 (+ 175us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:36.642034 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:36.643056 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.643923 (+ 867us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.645800 (+ 1877us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.646408 (+ 608us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.646539 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:36.651579 (+ 5040us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:40019: BlockingRecv error: recv got EOF from 127.12.155.129:40019 (error 108)
Metrics: {"server-negotiator.queue_time_us":140}
Aug 07 19:49:36 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:36 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:36.787606 28274 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:36.776659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:42485)
0807 19:49:36.777455 (+ 796us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:36.777475 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:36.777639 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:36.778005 (+ 366us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:36.778008 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:36.778675 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:36.778970 (+ 295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:36.778983 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.780199 (+ 1216us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.780206 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:36.781241 (+ 1035us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:36.781255 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.782264 (+ 1009us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.782272 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:36.782470 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:36.783331 (+ 861us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:36.783381 (+ 50us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:36.787315 (+ 3934us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":420,"threads_started":1}
W20260807 19:49:36.787894 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:36.776680 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:42485 (local address 127.12.155.190:39253)
0807 19:49:36.776925 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:36.776931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:36.777572 (+ 641us) server_negotiation.cc:407] Connection header received
0807 19:49:36.777765 (+ 193us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:36.777769 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:36.777848 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:36.777958 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:36.779150 (+ 1192us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.779998 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.781415 (+ 1417us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:36.781938 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:36.782124 (+ 186us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:36.787566 (+ 5442us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:42485: BlockingRecv error: recv got EOF from 127.12.155.131:42485 (error 108)
Metrics: {"server-negotiator.queue_time_us":81}
Aug 07 19:49:37 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:37 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:37.227090 28276 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:37.216147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:53489)
0807 19:49:37.216820 (+ 673us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:37.216840 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:37.217039 (+ 199us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:37.217449 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:37.217455 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:37.217972 (+ 517us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:37.218263 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:37.218275 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.219372 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.219376 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:37.220444 (+ 1068us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:37.220457 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.221247 (+ 790us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.221254 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:37.221468 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:37.222502 (+ 1034us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:37.222533 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:37.226764 (+ 4231us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":341,"threads_started":1}
W20260807 19:49:37.227509 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:37.216236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:53489 (local address 127.12.155.190:39253)
0807 19:49:37.216568 (+ 332us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:37.216578 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:37.216938 (+ 360us) server_negotiation.cc:407] Connection header received
0807 19:49:37.217196 (+ 258us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:37.217201 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:37.217278 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:37.217392 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:37.218423 (+ 1031us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.219199 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.220592 (+ 1393us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.221069 (+ 477us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.221214 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:37.227092 (+ 5878us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:53489: BlockingRecv error: recv got EOF from 127.12.155.130:53489 (error 108)
Metrics: {"server-negotiator.queue_time_us":130}
Aug 07 19:49:37 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:37 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:37.664582 28278 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:37.652865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:60147)
0807 19:49:37.653572 (+ 707us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:37.653591 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:37.653730 (+ 139us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:37.654306 (+ 576us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:37.654312 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:37.655097 (+ 785us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:37.655325 (+ 228us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:37.655338 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.657037 (+ 1699us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.657044 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:37.658386 (+ 1342us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:37.658405 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.659249 (+ 844us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.659255 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:37.659412 (+ 157us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:37.660215 (+ 803us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:37.660237 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:37.664088 (+ 3851us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":560,"thread_start_us":415,"threads_started":1}
W20260807 19:49:37.664776 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:37.652957 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:60147 (local address 127.12.155.190:39253)
0807 19:49:37.653219 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:37.653224 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:37.653701 (+ 477us) server_negotiation.cc:407] Connection header received
0807 19:49:37.653916 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:37.653921 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:37.654006 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:37.654219 (+ 213us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:37.655518 (+ 1299us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.656843 (+ 1325us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.658553 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.659043 (+ 490us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.659152 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:37.664400 (+ 5248us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:60147: BlockingRecv error: recv got EOF from 127.12.155.129:60147 (error 108)
Metrics: {"server-negotiator.queue_time_us":106}
Aug 07 19:49:37 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:37 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:37.799953 28280 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:37.789104 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:33161)
0807 19:49:37.789839 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:37.789866 (+ 27us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:37.790040 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:37.790467 (+ 427us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:37.790471 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:37.791001 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:37.791240 (+ 239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:37.791251 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.792613 (+ 1362us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.792618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:37.793913 (+ 1295us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:37.793929 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.794961 (+ 1032us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.794968 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:37.795120 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:37.795983 (+ 863us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:37.796004 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:37.799634 (+ 3630us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":578,"thread_start_us":401,"threads_started":1}
W20260807 19:49:37.800626 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:37.789110 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:33161 (local address 127.12.155.190:39253)
0807 19:49:37.789393 (+ 283us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:37.789400 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:37.789997 (+ 597us) server_negotiation.cc:407] Connection header received
0807 19:49:37.790205 (+ 208us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:37.790210 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:37.790295 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:37.790391 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:37.791436 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.792439 (+ 1003us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.794166 (+ 1727us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:37.794713 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:37.794846 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:37.800308 (+ 5462us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:33161: BlockingRecv error: recv got EOF from 127.12.155.131:33161 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
Aug 07 19:49:38 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:38 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:38.239363 28282 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:38.228497 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:42107)
0807 19:49:38.229266 (+ 769us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:38.229286 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:38.229440 (+ 154us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:38.229873 (+ 433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:38.229877 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:38.230446 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:38.230667 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:38.230680 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.231944 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.231949 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:38.233149 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:38.233164 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.233984 (+ 820us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.233989 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:38.234164 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:38.234938 (+ 774us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:38.234962 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:38.239048 (+ 4086us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":470,"threads_started":1}
W20260807 19:49:38.239574 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:38.228582 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:42107 (local address 127.12.155.190:39253)
0807 19:49:38.228791 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:38.228796 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:38.229371 (+ 575us) server_negotiation.cc:407] Connection header received
0807 19:49:38.229553 (+ 182us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:38.229557 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:38.229633 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:38.229725 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:38.230843 (+ 1118us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.231779 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.233301 (+ 1522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.233766 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.233878 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:38.239291 (+ 5413us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:42107: BlockingRecv error: recv got EOF from 127.12.155.130:42107 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 19:49:38 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:38 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:38.682226 28283 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:38.666262 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:49779)
0807 19:49:38.667063 (+ 801us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:38.667084 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:38.667307 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:38.667712 (+ 405us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:38.667717 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:38.668306 (+ 589us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:38.668540 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:38.668550 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.669694 (+ 1144us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.669701 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:38.670709 (+ 1008us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:38.670722 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.671521 (+ 799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.671527 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:38.671732 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:38.677561 (+ 5829us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:38.677594 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:38.681817 (+ 4223us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":473,"threads_started":1}
W20260807 19:49:38.682452 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:38.666523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:49779 (local address 127.12.155.190:39253)
0807 19:49:38.666839 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:38.666846 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:38.667189 (+ 343us) server_negotiation.cc:407] Connection header received
0807 19:49:38.667457 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:38.667470 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:38.667550 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:38.667676 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:38.668717 (+ 1041us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.669552 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.670871 (+ 1319us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.671343 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.671484 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:38.682166 (+ 10682us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:49779: BlockingRecv error: recv got EOF from 127.12.155.129:49779 (error 108)
Metrics: {"server-negotiator.queue_time_us":122}
Aug 07 19:49:38 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:38 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:38.813145 28284 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:38.801667 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:41681)
0807 19:49:38.802440 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:38.802458 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:38.802653 (+ 195us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:38.803127 (+ 474us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:38.803131 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:38.803611 (+ 480us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:38.803812 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:38.803822 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.805196 (+ 1374us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.805201 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:38.806338 (+ 1137us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:38.806355 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.807324 (+ 969us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.807329 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:38.807469 (+ 140us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:38.808513 (+ 1044us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:38.808535 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:38.812847 (+ 4312us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":644,"thread_start_us":435,"threads_started":1}
W20260807 19:49:38.813408 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:38.801818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:41681 (local address 127.12.155.190:39253)
0807 19:49:38.802131 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:38.802139 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:38.802565 (+ 426us) server_negotiation.cc:407] Connection header received
0807 19:49:38.802808 (+ 243us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:38.802813 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:38.802933 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:38.803059 (+ 126us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:38.804056 (+ 997us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.805021 (+ 965us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.806504 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:38.807121 (+ 617us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:38.807239 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:38.813130 (+ 5891us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:41681: BlockingRecv error: recv got EOF from 127.12.155.131:41681 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
Aug 07 19:49:39 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:39 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:39.251122 28285 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:39.240639 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:57937)
0807 19:49:39.241417 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:39.241436 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:39.241586 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:39.242073 (+ 487us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:39.242077 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:39.242615 (+ 538us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:39.242846 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:39.242856 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.244063 (+ 1207us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.244067 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:39.245060 (+ 993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:39.245073 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.246067 (+ 994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.246095 (+ 28us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:39.246313 (+ 218us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:39.247206 (+ 893us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:39.247233 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:39.250810 (+ 3577us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":636,"thread_start_us":438,"threads_started":1}
W20260807 19:49:39.251303 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:39.240793 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:57937 (local address 127.12.155.190:39253)
0807 19:49:39.241045 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:39.241050 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:39.241568 (+ 518us) server_negotiation.cc:407] Connection header received
0807 19:49:39.241708 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:39.241713 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:39.241885 (+ 172us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:39.241991 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:39.243013 (+ 1022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.243907 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.245221 (+ 1314us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.245826 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.245990 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:39.251043 (+ 5053us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:57937: BlockingRecv error: recv got EOF from 127.12.155.130:57937 (error 108)
Metrics: {"server-negotiator.queue_time_us":98}
Aug 07 19:49:39 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:39 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:39.694655 28286 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:39.683749 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:49831)
0807 19:49:39.684533 (+ 784us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:39.684553 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:39.684824 (+ 271us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:39.685536 (+ 712us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:39.685544 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:39.686127 (+ 583us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:39.686413 (+ 286us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:39.686433 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.687700 (+ 1267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.687706 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:39.688719 (+ 1013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:39.688731 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.689522 (+ 791us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.689528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:39.689758 (+ 230us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:39.690602 (+ 844us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:39.690622 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:39.694191 (+ 3569us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":599,"thread_start_us":412,"threads_started":1}
W20260807 19:49:39.694885 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:39.683932 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:49831 (local address 127.12.155.190:39253)
0807 19:49:39.684234 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:39.684240 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:39.684665 (+ 425us) server_negotiation.cc:407] Connection header received
0807 19:49:39.685097 (+ 432us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:39.685105 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:39.685210 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:39.685352 (+ 142us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:39.686583 (+ 1231us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.687547 (+ 964us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.688903 (+ 1356us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.689358 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.689508 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:39.694457 (+ 4949us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:49831: BlockingRecv error: recv got EOF from 127.12.155.129:49831 (error 108)
Metrics: {"server-negotiator.queue_time_us":97}
Aug 07 19:49:39 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:39 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:39.825969 28288 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:39.814464 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:43119)
0807 19:49:39.815119 (+ 655us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:39.815138 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:39.815361 (+ 223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:39.815789 (+ 428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:39.815795 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:39.816416 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:39.816648 (+ 232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:39.816659 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.817898 (+ 1239us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.817905 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:39.819062 (+ 1157us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:39.819078 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.819967 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.819974 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:39.820197 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:39.821005 (+ 808us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:39.821029 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:39.825518 (+ 4489us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":530,"thread_start_us":347,"threads_started":1}
W20260807 19:49:39.826323 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:39.814535 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:43119 (local address 127.12.155.190:39253)
0807 19:49:39.814848 (+ 313us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:39.814859 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:39.815247 (+ 388us) server_negotiation.cc:407] Connection header received
0807 19:49:39.815534 (+ 287us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:39.815545 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:39.815625 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:39.815803 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:39.816827 (+ 1024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.817721 (+ 894us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.819230 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:39.819777 (+ 547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:39.819947 (+ 170us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:39.825815 (+ 5868us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:43119: BlockingRecv error: recv got EOF from 127.12.155.131:43119 (error 108)
Metrics: {"server-negotiator.queue_time_us":66}
Aug 07 19:49:40 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:40 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:40.263470 28289 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:40.252570 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:48851)
0807 19:49:40.253351 (+ 781us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:40.253372 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:40.253620 (+ 248us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:40.254129 (+ 509us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:40.254136 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:40.254690 (+ 554us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:40.254912 (+ 222us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:40.254923 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.256250 (+ 1327us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.256258 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:40.257407 (+ 1149us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:40.257421 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.258393 (+ 972us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.258400 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:40.258631 (+ 231us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:40.259477 (+ 846us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:40.259500 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:40.263173 (+ 3673us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":614,"thread_start_us":451,"threads_started":1}
W20260807 19:49:40.263907 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:40.252715 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:48851 (local address 127.12.155.190:39253)
0807 19:49:40.253011 (+ 296us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:40.253016 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:40.253491 (+ 475us) server_negotiation.cc:407] Connection header received
0807 19:49:40.253792 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:40.253801 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:40.253899 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:40.254029 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:40.255096 (+ 1067us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.256074 (+ 978us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.257585 (+ 1511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.258199 (+ 614us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.258373 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:40.263480 (+ 5107us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:48851: BlockingRecv error: recv got EOF from 127.12.155.130:48851 (error 108)
Metrics: {"server-negotiator.queue_time_us":126}
Aug 07 19:49:40 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:40 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:40.707962 28290 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:40.696285 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:36229)
0807 19:49:40.697145 (+ 860us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:40.697171 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:40.697329 (+ 158us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:40.697824 (+ 495us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:40.697829 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:40.698495 (+ 666us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:40.698786 (+ 291us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:40.698804 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.700264 (+ 1460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.700268 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:40.701699 (+ 1431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:40.701716 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.702747 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.702753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:40.702981 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:40.703821 (+ 840us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:40.703846 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:40.707569 (+ 3723us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":693,"thread_start_us":508,"threads_started":1}
W20260807 19:49:40.708168 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:40.696517 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:36229 (local address 127.12.155.190:39253)
0807 19:49:40.696816 (+ 299us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:40.696825 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:40.697294 (+ 469us) server_negotiation.cc:407] Connection header received
0807 19:49:40.697499 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:40.697507 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:40.697627 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:40.697800 (+ 173us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:40.698971 (+ 1171us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.700103 (+ 1132us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.701925 (+ 1822us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.702540 (+ 615us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.702651 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:40.707888 (+ 5237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:36229: BlockingRecv error: recv got EOF from 127.12.155.129:36229 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 07 19:49:40 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:40 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:40.837587 28292 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:40.827307 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:37705)
0807 19:49:40.828056 (+ 749us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:40.828082 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:40.828265 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:40.828720 (+ 455us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:40.828726 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:40.829323 (+ 597us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:40.829515 (+ 192us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:40.829526 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.830897 (+ 1371us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.830902 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:40.831921 (+ 1019us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:40.831935 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.832736 (+ 801us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.832742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:40.832957 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:40.833689 (+ 732us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:40.833712 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:40.837160 (+ 3448us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":581,"thread_start_us":418,"threads_started":1}
W20260807 19:49:40.837826 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:40.827323 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:37705 (local address 127.12.155.190:39253)
0807 19:49:40.827628 (+ 305us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:40.827639 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:40.828181 (+ 542us) server_negotiation.cc:407] Connection header received
0807 19:49:40.828416 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:40.828421 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:40.828519 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:40.828651 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:40.829676 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.830724 (+ 1048us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.832089 (+ 1365us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:40.832575 (+ 486us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:40.832719 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:40.837451 (+ 4732us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:37705: BlockingRecv error: recv got EOF from 127.12.155.131:37705 (error 108)
Metrics: {"server-negotiator.queue_time_us":82}
Aug 07 19:49:41 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:41 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:41.276508 28294 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:41.264694 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:48677)
0807 19:49:41.265486 (+ 792us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:41.265504 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:41.265707 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:41.266408 (+ 701us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:41.266412 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:41.266909 (+ 497us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:41.267115 (+ 206us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:41.267127 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.268353 (+ 1226us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.268361 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:41.269379 (+ 1018us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:41.269394 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.270579 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.270585 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:41.270850 (+ 265us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:41.271682 (+ 832us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:41.271702 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:41.276092 (+ 4390us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":659,"thread_start_us":389,"threads_started":1}
W20260807 19:49:41.276803 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:41.264929 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:48677 (local address 127.12.155.190:39253)
0807 19:49:41.265310 (+ 381us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:41.265328 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:41.265621 (+ 293us) server_negotiation.cc:407] Connection header received
0807 19:49:41.265932 (+ 311us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:41.265937 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:41.266015 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:41.266146 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:41.267298 (+ 1152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.268174 (+ 876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.269545 (+ 1371us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.270347 (+ 802us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.270490 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:41.276454 (+ 5964us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:48677: BlockingRecv error: recv got EOF from 127.12.155.130:48677 (error 108)
Metrics: {"server-negotiator.queue_time_us":129}
Aug 07 19:49:41 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:41 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:41.719961 28295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:41.709283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:54447)
0807 19:49:41.709965 (+ 682us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:41.709984 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:41.710219 (+ 235us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:41.710649 (+ 430us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:41.710654 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:41.711178 (+ 524us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:41.711409 (+ 231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:41.711420 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.712599 (+ 1179us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.712605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:41.713622 (+ 1017us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:41.713635 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.714633 (+ 998us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.714642 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:41.714846 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:41.715928 (+ 1082us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:41.715957 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:41.719639 (+ 3682us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":532,"thread_start_us":354,"threads_started":1}
W20260807 19:49:41.720161 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:41.709490 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:54447 (local address 127.12.155.190:39253)
0807 19:49:41.709852 (+ 362us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:41.709860 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:41.710091 (+ 231us) server_negotiation.cc:407] Connection header received
0807 19:49:41.710406 (+ 315us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:41.710416 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:41.710493 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:41.710615 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:41.711576 (+ 961us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.712429 (+ 853us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.713787 (+ 1358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.714425 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.714561 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:41.719924 (+ 5363us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:54447: BlockingRecv error: recv got EOF from 127.12.155.129:54447 (error 108)
Metrics: {"server-negotiator.queue_time_us":90}
Aug 07 19:49:41 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:41 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:41.850317 28296 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:41.839197 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:51637)
0807 19:49:41.840045 (+ 848us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:41.840064 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:41.840290 (+ 226us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:41.840725 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:41.840730 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:41.841282 (+ 552us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:41.841498 (+ 216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:41.841509 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.842858 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.842868 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:41.844288 (+ 1420us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:41.844303 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.845314 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.845322 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:41.845520 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:41.846307 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:41.846330 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:41.849864 (+ 3534us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":691,"thread_start_us":405,"threads_started":1}
W20260807 19:49:41.850521 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:41.839280 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:51637 (local address 127.12.155.190:39253)
0807 19:49:41.839745 (+ 465us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:41.839753 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:41.840187 (+ 434us) server_negotiation.cc:407] Connection header received
0807 19:49:41.840456 (+ 269us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:41.840470 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:41.840550 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:41.840674 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:41.841681 (+ 1007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.842695 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.844463 (+ 1768us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:41.845084 (+ 621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:41.845260 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:41.850230 (+ 4970us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:51637: BlockingRecv error: recv got EOF from 127.12.155.131:51637 (error 108)
Metrics: {"server-negotiator.queue_time_us":235}
Aug 07 19:49:42 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:42 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:42.289198 28298 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:42.277968 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:50437)
0807 19:49:42.278684 (+ 716us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:42.278704 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:42.278990 (+ 286us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:42.279453 (+ 463us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:42.279459 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:42.280045 (+ 586us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:42.280368 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:42.280382 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.281820 (+ 1438us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.281831 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:42.283008 (+ 1177us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:42.283023 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.283868 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.283875 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:42.284084 (+ 209us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:42.284972 (+ 888us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:42.284996 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:42.288734 (+ 3738us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":401,"threads_started":1}
W20260807 19:49:42.289417 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:42.278106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:50437 (local address 127.12.155.190:39253)
0807 19:49:42.278415 (+ 309us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:42.278425 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:42.278881 (+ 456us) server_negotiation.cc:407] Connection header received
0807 19:49:42.279171 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:42.279177 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:42.279264 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:42.279407 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:42.280592 (+ 1185us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.281623 (+ 1031us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.283176 (+ 1553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.283676 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.283839 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:42.289024 (+ 5185us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:50437: BlockingRecv error: recv got EOF from 127.12.155.130:50437 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
Aug 07 19:49:42 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:42 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.129@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:42.733290 28299 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:42.721663 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.129:47305)
0807 19:49:42.722427 (+ 764us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:42.722449 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:42.722617 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:42.723182 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:42.723188 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:42.723981 (+ 793us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:42.724202 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:42.724213 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.725862 (+ 1649us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.725867 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:42.727006 (+ 1139us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:42.727021 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.728050 (+ 1029us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.728057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:42.728211 (+ 154us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:42.729158 (+ 947us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:42.729181 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:42.732938 (+ 3757us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":601,"thread_start_us":456,"threads_started":1}
W20260807 19:49:42.733857 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:42.721936 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:47305 (local address 127.12.155.190:39253)
0807 19:49:42.722293 (+ 357us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:42.722301 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:42.722554 (+ 253us) server_negotiation.cc:407] Connection header received
0807 19:49:42.722796 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:42.722801 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:42.722921 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:42.723023 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:42.724390 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.725697 (+ 1307us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.727180 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.727814 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.727935 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:42.733274 (+ 5339us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.129:47305: BlockingRecv error: recv got EOF from 127.12.155.129:47305 (error 108)
Metrics: {"server-negotiator.queue_time_us":147}
Aug 07 19:49:42 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:42 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.131@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:42.863449 28300 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:42.851888 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.131:53179)
0807 19:49:42.852577 (+ 689us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:42.852599 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:42.852791 (+ 192us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:42.853347 (+ 556us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:42.853353 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:42.853883 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:42.854177 (+ 294us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:42.854189 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.855747 (+ 1558us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.855753 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:42.857135 (+ 1382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:42.857162 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.858244 (+ 1082us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.858250 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:42.858414 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:42.859350 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:42.859373 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:42.863100 (+ 3727us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":394,"threads_started":1}
W20260807 19:49:42.863714 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:42.852005 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:53179 (local address 127.12.155.190:39253)
0807 19:49:42.852379 (+ 374us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:42.852390 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:42.852776 (+ 386us) server_negotiation.cc:407] Connection header received
0807 19:49:42.853012 (+ 236us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:42.853018 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:42.853108 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:42.853230 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:42.854388 (+ 1158us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.855437 (+ 1049us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.857300 (+ 1863us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:42.858042 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:42.858184 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:42.863421 (+ 5237us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.131:53179: BlockingRecv error: recv got EOF from 127.12.155.131:53179 (error 108)
Metrics: {"server-negotiator.queue_time_us":93}
Aug 07 19:49:43 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
Aug 07 19:49:43 dist-test-slave-2p8l krb5kdc[26697](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: LOOKING_UP_SERVER: authtime 0, oryx/127.12.155.130@KRBTEST.COM for oryx/127.12.155.190@KRBTEST.COM, Server not found in Kerberos database
I20260807 19:49:43.302269 28301 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:43.291147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:39253 (local address 127.12.155.130:42411)
0807 19:49:43.291867 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:43.291893 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:43.292073 (+ 180us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:43.292513 (+ 440us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:43.292517 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:43.292995 (+ 478us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:43.293197 (+ 202us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:43.293206 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.294632 (+ 1426us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.294636 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:43.295754 (+ 1118us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:43.295768 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.296804 (+ 1036us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.296810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:43.296969 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:43.297881 (+ 912us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:43.297905 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:43.301743 (+ 3838us) negotiation.cc:327] Negotiation complete: Not authorized: Client connection negotiation failed: client connection to 127.12.155.190:39253: Server oryx/127.12.155.190@KRBTEST.COM not found in Kerberos database
Metrics: {"client-negotiator.queue_time_us":535,"thread_start_us":371,"threads_started":1}
W20260807 19:49:43.302389 28021 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:43.291238 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:42411 (local address 127.12.155.190:39253)
0807 19:49:43.291554 (+ 316us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:43.291563 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:43.292018 (+ 455us) server_negotiation.cc:407] Connection header received
0807 19:49:43.292258 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:43.292263 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:43.292349 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:43.292456 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:43.293373 (+ 917us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.294473 (+ 1100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.295899 (+ 1426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.296555 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.296669 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:43.302067 (+ 5398us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.12.155.130:42411: BlockingRecv error: recv got EOF from 127.12.155.130:42411 (error 108)
Metrics: {"server-negotiator.queue_time_us":92}
I20260807 19:49:43.665786 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27604
I20260807 19:49:43.688509 28304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:43.667560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49718 (local address 127.12.155.129:41297)
0807 19:49:43.668352 (+ 792us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:43.668362 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:43.668398 (+ 36us) server_negotiation.cc:407] Connection header received
0807 19:49:43.668483 (+ 85us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:43.668491 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:43.668813 (+ 322us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:43.669017 (+ 204us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:43.671052 (+ 2035us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.672337 (+ 1285us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.673987 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.674850 (+ 863us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.675016 (+ 166us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:43.678554 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:43.678566 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:43.678592 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:43.678640 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:43.687693 (+ 9053us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.155.129@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 19:49:43.688206 (+ 513us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:49718: Request ticket server kudu/127.12.155.129@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":574,"thread_start_us":419,"threads_started":1}
W20260807 19:49:43.688623 28304 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:49718: Request ticket server kudu/127.12.155.129@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 19:49:43.689059 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27604: Not authorized: Client connection negotiation failed: client connection to 127.12.155.129:41297: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.155.129@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 19:49:43.689358 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 27604
I20260807 19:49:43.724174 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27829
I20260807 19:49:43.739904 28308 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:43.725803 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41810 (local address 127.12.155.130:34009)
0807 19:49:43.726698 (+ 895us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:43.726708 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:43.726749 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:49:43.726845 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:43.726853 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:43.727280 (+ 427us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:43.727483 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:43.729356 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.730792 (+ 1436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.732201 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.732843 (+ 642us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.732968 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:43.736074 (+ 3106us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:43.736085 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:43.736106 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:43.736147 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:43.739268 (+ 3121us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.155.130@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 19:49:43.739611 (+ 343us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:41810: Request ticket server kudu/127.12.155.130@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":708,"thread_start_us":528,"threads_started":1}
W20260807 19:49:43.740165 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27829: Not authorized: Client connection negotiation failed: client connection to 127.12.155.130:34009: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.155.130@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 19:49:43.740379 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 27829
I20260807 19:49:43.770176 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 28025
I20260807 19:49:43.786844 28310 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:43.771636 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48426 (local address 127.12.155.131:40941)
0807 19:49:43.772496 (+ 860us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:43.772506 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:43.772541 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:49:43.772631 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:43.772640 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:43.772985 (+ 345us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:43.773286 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:43.775324 (+ 2038us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.776651 (+ 1327us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.778244 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:43.778971 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:43.779098 (+ 127us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:43.782471 (+ 3373us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:43.782483 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:43.782504 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:43.782567 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:43.785902 (+ 3335us) server_negotiation.cc:394] Sending RPC error: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.155.131@KRBTEST.COM not found in keytab (ticket kvno 2)
0807 19:49:43.786516 (+ 614us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:48426: Request ticket server kudu/127.12.155.131@KRBTEST.COM not found in keytab (ticket kvno 2)
Metrics: {"server-negotiator.queue_time_us":671,"thread_start_us":485,"threads_started":1}
W20260807 19:49:43.787037 28310 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:48426: Request ticket server kudu/127.12.155.131@KRBTEST.COM not found in keytab (ticket kvno 2)
W20260807 19:49:43.787165 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 28025: Not authorized: Client connection negotiation failed: client connection to 127.12.155.131:40941: FATAL_UNAUTHORIZED: Not authorized: Request ticket server kudu/127.12.155.131@KRBTEST.COM not found in keytab (ticket kvno 2)
I20260807 19:49:43.787406 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 28025
I20260807 19:49:43.814754 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 27487
I20260807 19:49:43.816656 27588 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:43.961046 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 27487
2026-08-07T19:49:43Z chronyd exiting
[ OK ] SecurityITest.TestMismatchingPrincipals (23016 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationInsecureCluster
2026-08-07T19:49:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:44Z Disabled control of system clock
I20260807 19:49:44.083180 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42281
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:39491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:42281
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {}
W20260807 19:49:44.510957 28320 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:44.511449 28320 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:44.511546 28320 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:44.519774 28320 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:44.519933 28320 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:44.519975 28320 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:44.520032 28320 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:44.520087 28320 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:44.530603 28320 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:42281
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42281
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:44.532542 28320 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:44.534852 28320 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:44.548998 28328 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:44.549093 28327 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:44.549038 28330 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:44.550426 28320 server_base.cc:1034] running on GCE node
I20260807 19:49:44.551316 28320 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:44.553049 28320 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:44.554265 28320 hybrid_clock.cc:648] HybridClock initialized: now 1786132184554227 us; error 33 us; skew 500 ppm
I20260807 19:49:44.554720 28320 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:44.557484 28320 webserver.cc:460] Webserver started at http://127.12.155.190:37115/ using document root <none> and password file <none>
I20260807 19:49:44.558446 28320 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:44.558573 28320 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:44.558987 28320 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:44.562666 28320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "78609e2f98ca43c58fb4649cd5064919"
format_stamp: "Formatted at 2026-08-07 19:49:44 on dist-test-slave-2p8l"
server_key: "eea4c0712aa27206e40f711af44f02e1"
server_key_iv: "6fc8ff8cced28156c606cc4f73ae6986"
server_key_version: "encryptionkey@0"
I20260807 19:49:44.563619 28320 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "78609e2f98ca43c58fb4649cd5064919"
format_stamp: "Formatted at 2026-08-07 19:49:44 on dist-test-slave-2p8l"
server_key: "eea4c0712aa27206e40f711af44f02e1"
server_key_iv: "6fc8ff8cced28156c606cc4f73ae6986"
server_key_version: "encryptionkey@0"
I20260807 19:49:44.570123 28320 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:49:44.574702 28337 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:44.576668 28320 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:49:44.576875 28320 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "78609e2f98ca43c58fb4649cd5064919"
format_stamp: "Formatted at 2026-08-07 19:49:44 on dist-test-slave-2p8l"
server_key: "eea4c0712aa27206e40f711af44f02e1"
server_key_iv: "6fc8ff8cced28156c606cc4f73ae6986"
server_key_version: "encryptionkey@0"
I20260807 19:49:44.577222 28320 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:44.600818 28320 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:44.602200 28320 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:44.602604 28320 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:44.626423 28320 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:42281
I20260807 19:49:44.626470 28417 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:42281 every 8 connection(s)
I20260807 19:49:44.628295 28320 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:49:44.633494 28418 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:44.634845 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 28320
I20260807 19:49:44.635140 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:49:44.636404 12910 external_mini_cluster.cc:1428] Setting key c48eea5b0088582cce255b30de6528cb
I20260807 19:49:44.649371 28418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919: Bootstrap starting.
I20260807 19:49:44.654260 28427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:44.639660 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39146 (local address 127.12.155.190:42281)
0807 19:49:44.641137 (+ 1477us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:44.641151 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:44.641204 (+ 53us) server_negotiation.cc:407] Connection header received
0807 19:49:44.643230 (+ 2026us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:44.643271 (+ 41us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:44.643854 (+ 583us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:44.644341 (+ 487us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:44.645082 (+ 741us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:44.646688 (+ 1606us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:44.648205 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:44.649030 (+ 825us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:44.649290 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:44.651108 (+ 1818us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:44.651119 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:44.651138 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:44.651893 (+ 755us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:44.652015 (+ 122us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:44.652041 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:44.652198 (+ 157us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:44.652486 (+ 288us) server_negotiation.cc:299] Negotiation successful
0807 19:49:44.652906 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":933,"thread_start_us":607,"threads_started":1}
I20260807 19:49:44.654660 28418 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:44.656574 28418 log.cc:824] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:44.660610 28418 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919: No bootstrap required, opened a new log
I20260807 19:49:44.669726 28418 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78609e2f98ca43c58fb4649cd5064919" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42281 } }
I20260807 19:49:44.670384 28418 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:44.670514 28418 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78609e2f98ca43c58fb4649cd5064919, State: Initialized, Role: FOLLOWER
I20260807 19:49:44.671350 28418 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78609e2f98ca43c58fb4649cd5064919" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42281 } }
I20260807 19:49:44.671591 28418 raft_consensus.cc:388] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:49:44.671770 28418 raft_consensus.cc:482] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:49:44.671988 28418 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:44.675012 28418 raft_consensus.cc:504] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78609e2f98ca43c58fb4649cd5064919" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42281 } }
I20260807 19:49:44.675712 28418 leader_election.cc:302] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 78609e2f98ca43c58fb4649cd5064919; no voters:
I20260807 19:49:44.676491 28418 leader_election.cc:288] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:49:44.676805 28429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:44.677748 28429 raft_consensus.cc:686] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [term 1 LEADER]: Becoming Leader. State: Replica: 78609e2f98ca43c58fb4649cd5064919, State: Running, Role: LEADER
I20260807 19:49:44.678545 28429 consensus_queue.cc:237] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78609e2f98ca43c58fb4649cd5064919" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42281 } }
I20260807 19:49:44.679278 28418 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:44.682775 28431 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 78609e2f98ca43c58fb4649cd5064919. Latest consensus state: current_term: 1 leader_uuid: "78609e2f98ca43c58fb4649cd5064919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78609e2f98ca43c58fb4649cd5064919" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42281 } } }
I20260807 19:49:44.682749 28430 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "78609e2f98ca43c58fb4649cd5064919" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "78609e2f98ca43c58fb4649cd5064919" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42281 } } }
I20260807 19:49:44.683254 28431 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:44.683312 28430 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:44.685997 28436 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:44.692304 28436 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:44.704227 28436 catalog_manager.cc:1347] Generated new cluster ID: de0e370a89614766881b77ae0a84fc0d
I20260807 19:49:44.704416 28436 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:44.723800 28436 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:49:44.725576 28436 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:44.734830 28436 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 78609e2f98ca43c58fb4649cd5064919: Generated new TSK 0
I20260807 19:49:44.736086 28436 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:49:44.747313 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42281
--builtin_ntp_servers=127.12.155.148:39491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
W20260807 19:49:45.211436 28454 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:45.211825 28454 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:45.211923 28454 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:45.220196 28454 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:45.220332 28454 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:45.220517 28454 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:45.231168 28454 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:45.233095 28454 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:45.235625 28454 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:45.251827 28471 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:45.251931 28468 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:45.251896 28469 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:45.252944 28454 server_base.cc:1034] running on GCE node
I20260807 19:49:45.253724 28454 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:45.255079 28454 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:45.256346 28454 hybrid_clock.cc:648] HybridClock initialized: now 1786132185256289 us; error 53 us; skew 500 ppm
I20260807 19:49:45.256767 28454 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:45.260070 28454 webserver.cc:460] Webserver started at http://127.12.155.129:43725/ using document root <none> and password file <none>
I20260807 19:49:45.261087 28454 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:45.261248 28454 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:45.261672 28454 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:45.265501 28454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "63acebecfbba4ecdbeba593d2b37f898"
format_stamp: "Formatted at 2026-08-07 19:49:45 on dist-test-slave-2p8l"
server_key: "f94f5adf79732d114d8fbcd217149555"
server_key_iv: "00002b6acbfa5d1ea502c4a29f7de076"
server_key_version: "encryptionkey@0"
I20260807 19:49:45.266615 28454 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "63acebecfbba4ecdbeba593d2b37f898"
format_stamp: "Formatted at 2026-08-07 19:49:45 on dist-test-slave-2p8l"
server_key: "f94f5adf79732d114d8fbcd217149555"
server_key_iv: "00002b6acbfa5d1ea502c4a29f7de076"
server_key_version: "encryptionkey@0"
I20260807 19:49:45.273844 28454 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.001s
I20260807 19:49:45.278345 28479 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:45.280264 28454 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:45.280501 28454 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "63acebecfbba4ecdbeba593d2b37f898"
format_stamp: "Formatted at 2026-08-07 19:49:45 on dist-test-slave-2p8l"
server_key: "f94f5adf79732d114d8fbcd217149555"
server_key_iv: "00002b6acbfa5d1ea502c4a29f7de076"
server_key_version: "encryptionkey@0"
I20260807 19:49:45.280848 28454 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:45.306363 28454 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:45.307521 28454 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:45.307914 28454 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:45.309190 28454 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:45.311386 28454 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:45.311523 28454 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:45.311685 28454 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:45.311792 28454 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:45.355000 28454 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:38445
I20260807 19:49:45.355085 28659 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:38445 every 8 connection(s)
I20260807 19:49:45.356739 28454 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:45.361807 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 28454
I20260807 19:49:45.362099 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:49:45.363260 12910 external_mini_cluster.cc:1428] Setting key d36570f55359073b67a596f83d3ebf7f
I20260807 19:49:45.367424 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42281
--builtin_ntp_servers=127.12.155.148:39491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 19:49:45.375891 28664 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:45.360219 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:50707 (local address 127.12.155.190:42281)
0807 19:49:45.360783 (+ 564us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:45.360790 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:45.362865 (+ 2075us) server_negotiation.cc:407] Connection header received
0807 19:49:45.365464 (+ 2599us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:45.365471 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:45.365569 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:45.365724 (+ 155us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:45.367646 (+ 1922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.368467 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.371586 (+ 3119us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.372291 (+ 705us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.372444 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:45.374708 (+ 2264us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:45.374717 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:45.374725 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:45.374759 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:45.374824 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:45.374842 (+ 18us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:45.374929 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:45.375257 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 19:49:45.375400 (+ 143us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":416,"thread_start_us":267,"threads_started":1}
I20260807 19:49:45.377799 28667 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:45.361028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42281 (local address 127.12.155.129:50707)
0807 19:49:45.362596 (+ 1568us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:45.362674 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:45.365120 (+ 2446us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:45.366064 (+ 944us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:45.366106 (+ 42us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:45.366269 (+ 163us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:45.367368 (+ 1099us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:45.367403 (+ 35us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.368667 (+ 1264us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.368676 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:45.371383 (+ 2707us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:45.371404 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.372589 (+ 1185us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.372600 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:45.373023 (+ 423us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:45.374163 (+ 1140us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:49:45.374169 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:45.374258 (+ 89us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:49:45.374429 (+ 171us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:45.374955 (+ 526us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:45.374972 (+ 17us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:45.374984 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 19:49:45.375221 (+ 237us) client_negotiation.cc:240] Negotiation successful
0807 19:49:45.375843 (+ 622us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":706,"thread_start_us":408,"threads_started":1}
I20260807 19:49:45.380034 28661 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42281
I20260807 19:49:45.380542 28661 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:45.381664 28661 heartbeater.cc:511] Master 127.12.155.190:42281 requested a full tablet report, sending...
I20260807 19:49:45.384940 28364 ts_manager.cc:194] Registered new tserver with Master: 63acebecfbba4ecdbeba593d2b37f898 (127.12.155.129:38445)
I20260807 19:49:45.387692 28364 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.129:50707
W20260807 19:49:45.799212 28669 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:45.799618 28669 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:45.799715 28669 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:45.808066 28669 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:45.808220 28669 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:45.808416 28669 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:45.818635 28669 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:45.820592 28669 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:45.823335 28669 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:45.841238 28681 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:45.841279 28677 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:45.841251 28676 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:45.842188 28669 server_base.cc:1034] running on GCE node
I20260807 19:49:45.842949 28669 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:45.844164 28669 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:45.845394 28669 hybrid_clock.cc:648] HybridClock initialized: now 1786132185845325 us; error 56 us; skew 500 ppm
I20260807 19:49:45.845847 28669 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:45.849133 28669 webserver.cc:460] Webserver started at http://127.12.155.130:37151/ using document root <none> and password file <none>
I20260807 19:49:45.850282 28669 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:45.850399 28669 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:45.850903 28669 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:45.854727 28669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "b81803ca5fcd45b49fdd74d3b901c653"
format_stamp: "Formatted at 2026-08-07 19:49:45 on dist-test-slave-2p8l"
server_key: "b97a79e9440542e84faecad15dfbbad7"
server_key_iv: "4189a538dc2c4293e9879aa7525ebfed"
server_key_version: "encryptionkey@0"
I20260807 19:49:45.855763 28669 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "b81803ca5fcd45b49fdd74d3b901c653"
format_stamp: "Formatted at 2026-08-07 19:49:45 on dist-test-slave-2p8l"
server_key: "b97a79e9440542e84faecad15dfbbad7"
server_key_iv: "4189a538dc2c4293e9879aa7525ebfed"
server_key_version: "encryptionkey@0"
I20260807 19:49:45.862710 28669 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.005s
I20260807 19:49:45.867280 28695 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:45.869158 28669 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:49:45.869374 28669 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "b81803ca5fcd45b49fdd74d3b901c653"
format_stamp: "Formatted at 2026-08-07 19:49:45 on dist-test-slave-2p8l"
server_key: "b97a79e9440542e84faecad15dfbbad7"
server_key_iv: "4189a538dc2c4293e9879aa7525ebfed"
server_key_version: "encryptionkey@0"
I20260807 19:49:45.869634 28669 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:45.889513 28669 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:45.890728 28669 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:45.891196 28669 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:45.892460 28669 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:45.894467 28669 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:45.894599 28669 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:45.894762 28669 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:45.894877 28669 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:45.937629 28669 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:40597
I20260807 19:49:45.937685 28862 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:40597 every 8 connection(s)
I20260807 19:49:45.940080 28669 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:45.941933 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 28669
I20260807 19:49:45.942435 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:49:45.943169 12910 external_mini_cluster.cc:1428] Setting key 935053c36e2f68c26584e0fb77d190fd
I20260807 19:49:45.947465 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42281
--builtin_ntp_servers=127.12.155.148:39491
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {}
I20260807 19:49:45.956664 28866 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:45.944502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:45731 (local address 127.12.155.190:42281)
0807 19:49:45.945196 (+ 694us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:45.945203 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:45.946938 (+ 1735us) server_negotiation.cc:407] Connection header received
0807 19:49:45.949154 (+ 2216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:45.949160 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:45.949268 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:45.949407 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:45.950782 (+ 1375us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.951591 (+ 809us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.953251 (+ 1660us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.953706 (+ 455us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.953858 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:45.955640 (+ 1782us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:45.955646 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:45.955650 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:45.955674 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:45.955725 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:45.955745 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:45.955853 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:45.956108 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 19:49:45.956237 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":547,"thread_start_us":374,"threads_started":1}
I20260807 19:49:45.957959 28867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:45.945434 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42281 (local address 127.12.155.130:45731)
0807 19:49:45.946752 (+ 1318us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:45.946800 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:45.948838 (+ 2038us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:45.949691 (+ 853us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:45.949702 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:45.949810 (+ 108us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:45.950594 (+ 784us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:45.950614 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.951750 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.951757 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:45.953091 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:45.953104 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:45.954003 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:45.954012 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:45.954332 (+ 320us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:45.955210 (+ 878us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:49:45.955213 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:45.955271 (+ 58us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:49:45.955369 (+ 98us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:45.955849 (+ 480us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:45.955861 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:45.955872 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:49:45.956080 (+ 208us) client_negotiation.cc:240] Negotiation successful
0807 19:49:45.956574 (+ 494us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":738,"thread_start_us":499,"threads_started":1}
I20260807 19:49:45.959821 28863 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42281
I20260807 19:49:45.960222 28863 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:45.961395 28863 heartbeater.cc:511] Master 127.12.155.190:42281 requested a full tablet report, sending...
I20260807 19:49:45.963464 28364 ts_manager.cc:194] Registered new tserver with Master: b81803ca5fcd45b49fdd74d3b901c653 (127.12.155.130:40597)
I20260807 19:49:45.964423 28364 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.130:45731
W20260807 19:49:46.361763 28868 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:46.362255 28868 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:46.362399 28868 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:46.370729 28868 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:46.370859 28868 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:46.370980 28868 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:46.381362 28868 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39491
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42281
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:46.383143 28868 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:46.385566 28868 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 19:49:46.392216 28661 heartbeater.cc:503] Master 127.12.155.190:42281 was elected leader, sending a full tablet report...
W20260807 19:49:46.402113 28879 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:46.401996 28881 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:46.402117 28878 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:46.403331 28868 server_base.cc:1034] running on GCE node
I20260807 19:49:46.404138 28868 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:46.405540 28868 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:46.406810 28868 hybrid_clock.cc:648] HybridClock initialized: now 1786132186406703 us; error 95 us; skew 500 ppm
I20260807 19:49:46.407272 28868 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:46.410459 28868 webserver.cc:460] Webserver started at http://127.12.155.131:43571/ using document root <none> and password file <none>
I20260807 19:49:46.411442 28868 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:46.411602 28868 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:46.412024 28868 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:46.415817 28868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "a3e46b1af7a14dd483fa8d4b23ed90d4"
format_stamp: "Formatted at 2026-08-07 19:49:46 on dist-test-slave-2p8l"
server_key: "2cbc9c8ba20907b18a9fc24036e79f8b"
server_key_iv: "799858e249bed18e7db387b9948f7a0b"
server_key_version: "encryptionkey@0"
I20260807 19:49:46.416795 28868 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "a3e46b1af7a14dd483fa8d4b23ed90d4"
format_stamp: "Formatted at 2026-08-07 19:49:46 on dist-test-slave-2p8l"
server_key: "2cbc9c8ba20907b18a9fc24036e79f8b"
server_key_iv: "799858e249bed18e7db387b9948f7a0b"
server_key_version: "encryptionkey@0"
I20260807 19:49:46.423465 28868 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.002s sys 0.005s
I20260807 19:49:46.428376 28891 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:46.430320 28868 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.000s
I20260807 19:49:46.430548 28868 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "a3e46b1af7a14dd483fa8d4b23ed90d4"
format_stamp: "Formatted at 2026-08-07 19:49:46 on dist-test-slave-2p8l"
server_key: "2cbc9c8ba20907b18a9fc24036e79f8b"
server_key_iv: "799858e249bed18e7db387b9948f7a0b"
server_key_version: "encryptionkey@0"
I20260807 19:49:46.430924 28868 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:46.454533 28868 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:46.455796 28868 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:46.456282 28868 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:46.457612 28868 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:46.459687 28868 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:46.459909 28868 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:46.460068 28868 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:46.460186 28868 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:46.503238 28868 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:40353
I20260807 19:49:46.503291 29067 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:40353 every 8 connection(s)
I20260807 19:49:46.505065 28868 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:46.507813 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 28868
I20260807 19:49:46.508045 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:49:46.508667 12910 external_mini_cluster.cc:1428] Setting key 0696b6a188232d9ba0b5e86a1ccdb5a1
I20260807 19:49:46.522274 29071 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:46.508869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:36471 (local address 127.12.155.190:42281)
0807 19:49:46.509474 (+ 605us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:46.509481 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:46.511905 (+ 2424us) server_negotiation.cc:407] Connection header received
0807 19:49:46.514238 (+ 2333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:46.514244 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:46.514340 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:46.514467 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:46.515871 (+ 1404us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.516891 (+ 1020us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.518895 (+ 2004us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.519332 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.519443 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:46.521281 (+ 1838us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:46.521286 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:46.521290 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:46.521313 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:46.521370 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:46.521382 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:46.521460 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:46.521749 (+ 289us) server_negotiation.cc:299] Negotiation successful
0807 19:49:46.521860 (+ 111us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":444,"thread_start_us":274,"threads_started":1}
I20260807 19:49:46.523839 29072 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:46.509590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42281 (local address 127.12.155.131:36471)
0807 19:49:46.511704 (+ 2114us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:46.511759 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:46.513831 (+ 2072us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:46.514717 (+ 886us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:46.514727 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:46.514920 (+ 193us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:46.515661 (+ 741us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:46.515680 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.517076 (+ 1396us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.517080 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:46.518734 (+ 1654us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:46.518759 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.519601 (+ 842us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.519608 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:46.519941 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:46.520886 (+ 945us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:49:46.520889 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:46.520951 (+ 62us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:49:46.521065 (+ 114us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:46.521508 (+ 443us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:46.521519 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:46.521528 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 19:49:46.521728 (+ 200us) client_negotiation.cc:240] Negotiation successful
0807 19:49:46.522217 (+ 489us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1525,"thread_start_us":760,"threads_started":1}
I20260807 19:49:46.525559 29068 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42281
I20260807 19:49:46.525974 29068 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:46.527014 29068 heartbeater.cc:511] Master 127.12.155.190:42281 requested a full tablet report, sending...
I20260807 19:49:46.528779 28364 ts_manager.cc:194] Registered new tserver with Master: a3e46b1af7a14dd483fa8d4b23ed90d4 (127.12.155.131:40353)
I20260807 19:49:46.529927 28364 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.131:36471
I20260807 19:49:46.539114 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 19:49:46.547034 29071 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:46.544977 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48364 (local address 127.12.155.190:42281)
0807 19:49:46.545229 (+ 252us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:46.545238 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:46.545838 (+ 600us) server_negotiation.cc:407] Connection header received
0807 19:49:46.545957 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:46.545961 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:46.546039 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:46.546185 (+ 146us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:46.546718 (+ 533us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48364: BlockingRecv error: recv got EOF from 127.0.0.1:48364 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:49:46.547986 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 28454
I20260807 19:49:46.558197 29085 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:46.549296 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59796 (local address 127.12.155.129:38445)
0807 19:49:46.550036 (+ 740us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:46.550045 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:46.550140 (+ 95us) server_negotiation.cc:407] Connection header received
0807 19:49:46.550221 (+ 81us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:46.550230 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:46.550531 (+ 301us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:46.550784 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:46.551316 (+ 532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.552524 (+ 1208us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.553992 (+ 1468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.554789 (+ 797us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.554956 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:46.556306 (+ 1350us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:46.556317 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:46.556335 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:46.557091 (+ 756us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:46.557157 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:46.557181 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:46.557342 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:46.557520 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 19:49:46.557697 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":543,"thread_start_us":325,"threads_started":1}
I20260807 19:49:46.559806 28652 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:46.655412 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 28454
I20260807 19:49:46.690270 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 28669
I20260807 19:49:46.700717 29087 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:46.691574 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46660 (local address 127.12.155.130:40597)
0807 19:49:46.692435 (+ 861us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:46.692444 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:46.692482 (+ 38us) server_negotiation.cc:407] Connection header received
0807 19:49:46.692579 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:46.692588 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:46.692978 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:46.693159 (+ 181us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:46.693672 (+ 513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.694987 (+ 1315us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.696547 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.697231 (+ 684us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.697341 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:46.698854 (+ 1513us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:46.698866 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:46.698886 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:46.699729 (+ 843us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:46.699814 (+ 85us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:46.699840 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:46.699954 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:46.700138 (+ 184us) server_negotiation.cc:299] Negotiation successful
0807 19:49:46.700321 (+ 183us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":652,"thread_start_us":488,"threads_started":1}
I20260807 19:49:46.702600 28858 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:46.796532 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 28669
I20260807 19:49:46.828024 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 28868
I20260807 19:49:46.838449 29091 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:46.829293 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38786 (local address 127.12.155.131:40353)
0807 19:49:46.830166 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:46.830178 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:46.830225 (+ 47us) server_negotiation.cc:407] Connection header received
0807 19:49:46.830315 (+ 90us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:46.830323 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:46.830632 (+ 309us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:46.830850 (+ 218us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:46.831445 (+ 595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.832619 (+ 1174us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.834029 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:46.834738 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:46.834891 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:46.836381 (+ 1490us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:46.836392 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:46.836411 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:46.837338 (+ 927us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:46.837402 (+ 64us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:46.837428 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:46.837543 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:46.837732 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 19:49:46.837908 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":602,"thread_start_us":407,"threads_started":1}
I20260807 19:49:46.840277 29060 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:46.931293 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 28868
I20260807 19:49:46.965041 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 28320
I20260807 19:49:46.966851 28412 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:47.090780 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 28320
2026-08-07T19:49:47Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationInsecureCluster (3125 ms)
[ RUN ] SecurityITest.TestRequireEncryptionInsecureCluster
2026-08-07T19:49:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:47Z Disabled control of system clock
I20260807 19:49:47.208945 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:35893
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:43645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:35893
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 19:49:47.629535 29099 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:47.629968 29099 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:47.630167 29099 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:47.638497 29099 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:47.638656 29099 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:47.638696 29099 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:47.638823 29099 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:47.638888 29099 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:47.649750 29099 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:35893
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:35893
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:47.651757 29099 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:47.654359 29099 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:47.669504 29112 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:47.669574 29109 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:47.669819 29108 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:47.670785 29099 server_base.cc:1034] running on GCE node
I20260807 19:49:47.671828 29099 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:47.673704 29099 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:47.674945 29099 hybrid_clock.cc:648] HybridClock initialized: now 1786132187674869 us; error 62 us; skew 500 ppm
I20260807 19:49:47.675400 29099 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:47.678329 29099 webserver.cc:460] Webserver started at http://127.12.155.190:39651/ using document root <none> and password file <none>
I20260807 19:49:47.679243 29099 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:47.679369 29099 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:47.679797 29099 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:47.683645 29099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "41b77f29440247839512135ecc020106"
format_stamp: "Formatted at 2026-08-07 19:49:47 on dist-test-slave-2p8l"
server_key: "202d063056c3039056d0f950a914aa83"
server_key_iv: "bdc738e0b86da73eddbe4c82b865b2ee"
server_key_version: "encryptionkey@0"
I20260807 19:49:47.684702 29099 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "41b77f29440247839512135ecc020106"
format_stamp: "Formatted at 2026-08-07 19:49:47 on dist-test-slave-2p8l"
server_key: "202d063056c3039056d0f950a914aa83"
server_key_iv: "bdc738e0b86da73eddbe4c82b865b2ee"
server_key_version: "encryptionkey@0"
I20260807 19:49:47.691504 29099 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.007s sys 0.001s
I20260807 19:49:47.696034 29123 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:47.697814 29099 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.004s
I20260807 19:49:47.698105 29099 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "41b77f29440247839512135ecc020106"
format_stamp: "Formatted at 2026-08-07 19:49:47 on dist-test-slave-2p8l"
server_key: "202d063056c3039056d0f950a914aa83"
server_key_iv: "bdc738e0b86da73eddbe4c82b865b2ee"
server_key_version: "encryptionkey@0"
I20260807 19:49:47.698439 29099 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:47.705426 29099 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:47.706795 29099 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:47.707203 29099 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:47.731812 29099 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:35893
I20260807 19:49:47.731868 29196 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:35893 every 8 connection(s)
I20260807 19:49:47.733902 29099 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:49:47.735903 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 29099
I20260807 19:49:47.736164 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:49:47.737136 12910 external_mini_cluster.cc:1428] Setting key 0a072c1a7ce929ba7cfad37a833e80a9
I20260807 19:49:47.740270 29198 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:47.747941 29204 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:47.739935 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60020 (local address 127.12.155.190:35893)
0807 19:49:47.741344 (+ 1409us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:47.741358 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:47.741409 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:49:47.743392 (+ 1983us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:47.743419 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:47.743939 (+ 520us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:47.744348 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:47.745851 (+ 1503us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:47.745861 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:47.745876 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:47.745894 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:47.745986 (+ 92us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:47.746006 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:47.746277 (+ 271us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:47.746402 (+ 125us) server_negotiation.cc:299] Negotiation successful
0807 19:49:47.746786 (+ 384us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":756,"thread_start_us":485,"threads_started":1}
I20260807 19:49:47.755007 29198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106: Bootstrap starting.
I20260807 19:49:47.759114 29198 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:47.760562 29198 log.cc:824] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:47.764083 29198 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106: No bootstrap required, opened a new log
I20260807 19:49:47.772629 29198 raft_consensus.cc:348] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b77f29440247839512135ecc020106" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35893 } }
I20260807 19:49:47.773135 29198 raft_consensus.cc:374] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:47.773298 29198 raft_consensus.cc:729] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 41b77f29440247839512135ecc020106, State: Initialized, Role: FOLLOWER
I20260807 19:49:47.774024 29198 consensus_queue.cc:260] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b77f29440247839512135ecc020106" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35893 } }
I20260807 19:49:47.774402 29198 raft_consensus.cc:388] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:49:47.774571 29198 raft_consensus.cc:482] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:49:47.774782 29198 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:47.777367 29198 raft_consensus.cc:504] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b77f29440247839512135ecc020106" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35893 } }
I20260807 19:49:47.778129 29198 leader_election.cc:302] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 41b77f29440247839512135ecc020106; no voters:
I20260807 19:49:47.778959 29198 leader_election.cc:288] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:49:47.779250 29206 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:47.780269 29206 raft_consensus.cc:686] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [term 1 LEADER]: Becoming Leader. State: Replica: 41b77f29440247839512135ecc020106, State: Running, Role: LEADER
I20260807 19:49:47.781113 29206 consensus_queue.cc:237] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b77f29440247839512135ecc020106" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35893 } }
I20260807 19:49:47.781953 29198 sys_catalog.cc:564] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:47.786019 29209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 41b77f29440247839512135ecc020106. Latest consensus state: current_term: 1 leader_uuid: "41b77f29440247839512135ecc020106" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b77f29440247839512135ecc020106" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35893 } } }
I20260807 19:49:47.785918 29208 sys_catalog.cc:455] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "41b77f29440247839512135ecc020106" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "41b77f29440247839512135ecc020106" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 35893 } } }
I20260807 19:49:47.786553 29209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:47.786563 29208 sys_catalog.cc:458] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106 [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:47.789485 29223 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:47.796270 29223 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:47.809139 29223 catalog_manager.cc:1347] Generated new cluster ID: 0dd8fe6a4cc64a3e8ff2e6d480f8b070
I20260807 19:49:47.809362 29223 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:47.858495 29223 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:49:47.859119 29223 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:47.870590 29223 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 41b77f29440247839512135ecc020106: Generated new TSK 0
I20260807 19:49:47.871814 29223 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:49:47.897118 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35893
--builtin_ntp_servers=127.12.155.148:43645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
W20260807 19:49:48.313490 29236 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:48.313869 29236 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:48.313978 29236 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:48.321862 29236 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:48.322005 29236 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:48.322213 29236 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:48.332178 29236 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:48.333913 29236 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:48.336213 29236 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:48.352213 29244 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:48.352259 29245 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:48.352175 29251 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:48.353130 29236 server_base.cc:1034] running on GCE node
I20260807 19:49:48.354000 29236 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:48.355284 29236 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:48.356529 29236 hybrid_clock.cc:648] HybridClock initialized: now 1786132188356475 us; error 66 us; skew 500 ppm
I20260807 19:49:48.356912 29236 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:48.359711 29236 webserver.cc:460] Webserver started at http://127.12.155.129:36473/ using document root <none> and password file <none>
I20260807 19:49:48.360606 29236 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:48.360749 29236 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:48.361142 29236 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:48.364634 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "dee00395738845bc8bed5473ad1e5d1f"
format_stamp: "Formatted at 2026-08-07 19:49:48 on dist-test-slave-2p8l"
server_key: "dcc8b2708546704060d675c6f11b71b7"
server_key_iv: "2347e65e1392b27a2f2ff9157290f9d8"
server_key_version: "encryptionkey@0"
I20260807 19:49:48.365649 29236 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "dee00395738845bc8bed5473ad1e5d1f"
format_stamp: "Formatted at 2026-08-07 19:49:48 on dist-test-slave-2p8l"
server_key: "dcc8b2708546704060d675c6f11b71b7"
server_key_iv: "2347e65e1392b27a2f2ff9157290f9d8"
server_key_version: "encryptionkey@0"
I20260807 19:49:48.371904 29236 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 19:49:48.376072 29260 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:48.377842 29236 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:49:48.378150 29236 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "dee00395738845bc8bed5473ad1e5d1f"
format_stamp: "Formatted at 2026-08-07 19:49:48 on dist-test-slave-2p8l"
server_key: "dcc8b2708546704060d675c6f11b71b7"
server_key_iv: "2347e65e1392b27a2f2ff9157290f9d8"
server_key_version: "encryptionkey@0"
I20260807 19:49:48.378439 29236 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:48.386641 29236 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:48.387738 29236 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:48.388079 29236 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:48.389307 29236 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:48.391228 29236 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:48.391381 29236 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:48.391527 29236 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:48.391628 29236 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:48.435091 29236 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:37103
I20260807 19:49:48.435124 29430 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:37103 every 8 connection(s)
I20260807 19:49:48.436931 29236 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:48.447371 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 29236
I20260807 19:49:48.447680 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:49:48.448045 29436 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:48.440366 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:48661 (local address 127.12.155.190:35893)
0807 19:49:48.441099 (+ 733us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:48.441107 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:48.442634 (+ 1527us) server_negotiation.cc:407] Connection header received
0807 19:49:48.444736 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:48.444741 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:48.444864 (+ 123us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:48.444989 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:48.446885 (+ 1896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:48.446890 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:48.446894 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:48.446914 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:48.446968 (+ 54us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:48.446981 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:48.447102 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:48.447457 (+ 355us) server_negotiation.cc:299] Negotiation successful
0807 19:49:48.447584 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":549,"thread_start_us":293,"threads_started":1}
I20260807 19:49:48.448807 12910 external_mini_cluster.cc:1428] Setting key f6e2985aaf6c5a6a4afc5fecdb315b9d
I20260807 19:49:48.449530 29438 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:48.441135 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35893 (local address 127.12.155.129:48661)
0807 19:49:48.442429 (+ 1294us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:48.442475 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:48.444368 (+ 1893us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:48.445304 (+ 936us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:48.445315 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:48.445428 (+ 113us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:48.446404 (+ 976us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:49:48.446407 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:48.446459 (+ 52us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:49:48.446596 (+ 137us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:48.447109 (+ 513us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:48.447122 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:48.447134 (+ 12us) client_negotiation.cc:769] Sending connection context
0807 19:49:48.447535 (+ 401us) client_negotiation.cc:240] Negotiation successful
0807 19:49:48.447905 (+ 370us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":346,"threads_started":1}
I20260807 19:49:48.451691 29433 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35893
I20260807 19:49:48.452121 29433 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:48.453080 29433 heartbeater.cc:511] Master 127.12.155.190:35893 requested a full tablet report, sending...
I20260807 19:49:48.453289 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35893
--builtin_ntp_servers=127.12.155.148:43645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 19:49:48.456401 29145 ts_manager.cc:194] Registered new tserver with Master: dee00395738845bc8bed5473ad1e5d1f (127.12.155.129:37103)
W20260807 19:49:48.871853 29439 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:48.872299 29439 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:48.872476 29439 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:48.880769 29439 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:48.880956 29439 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:48.881155 29439 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:48.891853 29439 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:48.893728 29439 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:48.896083 29439 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:48.912827 29446 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:48.912968 29447 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:48.913818 29450 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:48.914399 29439 server_base.cc:1034] running on GCE node
I20260807 19:49:48.915181 29439 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:48.916489 29439 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:48.917752 29439 hybrid_clock.cc:648] HybridClock initialized: now 1786132188917689 us; error 73 us; skew 500 ppm
I20260807 19:49:48.918219 29439 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:48.924401 29439 webserver.cc:460] Webserver started at http://127.12.155.130:38667/ using document root <none> and password file <none>
I20260807 19:49:48.925410 29439 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:48.925578 29439 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:48.926007 29439 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:48.929837 29439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "4c4d3b278e094c1691f756b656030348"
format_stamp: "Formatted at 2026-08-07 19:49:48 on dist-test-slave-2p8l"
server_key: "6ef924b06e0ac9c0f807acc8eaec5426"
server_key_iv: "5a820099a0b91e2c7b7174cbd23b0d18"
server_key_version: "encryptionkey@0"
I20260807 19:49:48.930930 29439 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "4c4d3b278e094c1691f756b656030348"
format_stamp: "Formatted at 2026-08-07 19:49:48 on dist-test-slave-2p8l"
server_key: "6ef924b06e0ac9c0f807acc8eaec5426"
server_key_iv: "5a820099a0b91e2c7b7174cbd23b0d18"
server_key_version: "encryptionkey@0"
I20260807 19:49:48.937813 29439 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:49:48.942343 29462 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:48.944247 29439 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:49:48.944489 29439 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "4c4d3b278e094c1691f756b656030348"
format_stamp: "Formatted at 2026-08-07 19:49:48 on dist-test-slave-2p8l"
server_key: "6ef924b06e0ac9c0f807acc8eaec5426"
server_key_iv: "5a820099a0b91e2c7b7174cbd23b0d18"
server_key_version: "encryptionkey@0"
I20260807 19:49:48.944774 29439 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:48.952121 29439 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:48.953277 29439 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:48.953608 29439 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:48.954882 29439 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:48.956691 29439 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:48.956830 29439 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:48.956990 29439 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:48.957086 29439 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:48.996635 29439 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:41961
I20260807 19:49:48.996685 29646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:41961 every 8 connection(s)
I20260807 19:49:48.998389 29439 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:49.004580 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 29439
I20260807 19:49:49.004830 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:49:49.005362 12910 external_mini_cluster.cc:1428] Setting key 44d30e9a4420e3ead22d86e2c0c67e0c
I20260807 19:49:49.009042 29650 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.001678 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:53275 (local address 127.12.155.190:35893)
0807 19:49:49.002325 (+ 647us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:49.002330 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:49.003854 (+ 1524us) server_negotiation.cc:407] Connection header received
0807 19:49:49.006046 (+ 2192us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:49.006052 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:49.006171 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:49.006315 (+ 144us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:49.008117 (+ 1802us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:49.008123 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:49.008128 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:49.008157 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:49.008208 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:49.008221 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:49.008360 (+ 139us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:49.008585 (+ 225us) server_negotiation.cc:299] Negotiation successful
0807 19:49:49.008673 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":495,"thread_start_us":352,"threads_started":1}
I20260807 19:49:49.009063 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35893
--builtin_ntp_servers=127.12.155.148:43645
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_encryption=disabled
--rpc_authentication=disabled with env {}
I20260807 19:49:49.010373 29653 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.002425 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35893 (local address 127.12.155.130:53275)
0807 19:49:49.003651 (+ 1226us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:49.003696 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:49.005701 (+ 2005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:49.006661 (+ 960us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:49.006675 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:49.006825 (+ 150us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:49.007766 (+ 941us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:49:49.007769 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:49.007817 (+ 48us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:49:49.007930 (+ 113us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:49.008335 (+ 405us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:49.008348 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:49.008357 (+ 9us) client_negotiation.cc:769] Sending connection context
0807 19:49:49.008687 (+ 330us) client_negotiation.cc:240] Negotiation successful
0807 19:49:49.009033 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":548,"thread_start_us":305,"threads_started":1}
I20260807 19:49:49.012290 29648 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35893
I20260807 19:49:49.012665 29648 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:49.013441 29648 heartbeater.cc:511] Master 127.12.155.190:35893 requested a full tablet report, sending...
I20260807 19:49:49.015344 29145 ts_manager.cc:194] Registered new tserver with Master: 4c4d3b278e094c1691f756b656030348 (127.12.155.130:41961)
W20260807 19:49:49.440140 29654 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:49.440539 29654 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:49.440796 29654 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:49.448920 29654 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:49.449091 29654 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:49.449317 29654 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:49.459739 29654 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43645
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:35893
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:49.461026 29433 heartbeater.cc:503] Master 127.12.155.190:35893 was elected leader, sending a full tablet report...
I20260807 19:49:49.461812 29654 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:49.464311 29654 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:49.480576 29662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:49.480635 29664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:49.480535 29666 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:49.482010 29654 server_base.cc:1034] running on GCE node
I20260807 19:49:49.482775 29654 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:49.484102 29654 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:49.485340 29654 hybrid_clock.cc:648] HybridClock initialized: now 1786132189485271 us; error 51 us; skew 500 ppm
I20260807 19:49:49.485702 29654 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:49:49.488968 29654 webserver.cc:460] Webserver started at http://127.12.155.131:46057/ using document root <none> and password file <none>
I20260807 19:49:49.489918 29654 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:49.490119 29654 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:49.490552 29654 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:49.494634 29654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "d672c25bfdf140a6979a048a6a01137b"
format_stamp: "Formatted at 2026-08-07 19:49:49 on dist-test-slave-2p8l"
server_key: "011c802f1a0bcc0b60eb640ba79249b7"
server_key_iv: "a7debb4f2fd2a04b74ad18dd897cd539"
server_key_version: "encryptionkey@0"
I20260807 19:49:49.495678 29654 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "d672c25bfdf140a6979a048a6a01137b"
format_stamp: "Formatted at 2026-08-07 19:49:49 on dist-test-slave-2p8l"
server_key: "011c802f1a0bcc0b60eb640ba79249b7"
server_key_iv: "a7debb4f2fd2a04b74ad18dd897cd539"
server_key_version: "encryptionkey@0"
I20260807 19:49:49.502890 29654 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.006s sys 0.002s
I20260807 19:49:49.507611 29672 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:49.509737 29654 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.005s sys 0.001s
I20260807 19:49:49.509981 29654 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "d672c25bfdf140a6979a048a6a01137b"
format_stamp: "Formatted at 2026-08-07 19:49:49 on dist-test-slave-2p8l"
server_key: "011c802f1a0bcc0b60eb640ba79249b7"
server_key_iv: "a7debb4f2fd2a04b74ad18dd897cd539"
server_key_version: "encryptionkey@0"
I20260807 19:49:49.510352 29654 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:49.519125 29654 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:49.520270 29654 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:49.520622 29654 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:49.521893 29654 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:49.523993 29654 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:49.524149 29654 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:49.524317 29654 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:49.524421 29654 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:49.567945 29654 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:39633
I20260807 19:49:49.568006 29850 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:39633 every 8 connection(s)
I20260807 19:49:49.569785 29654 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:49.574400 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 29654
I20260807 19:49:49.574688 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireEncryptionInsecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:49:49.575297 12910 external_mini_cluster.cc:1428] Setting key 2b36aa053021e6214ac14e218db8639d
I20260807 19:49:49.581115 29861 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.573043 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:41179 (local address 127.12.155.190:35893)
0807 19:49:49.573636 (+ 593us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:49.573642 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:49.575885 (+ 2243us) server_negotiation.cc:407] Connection header received
0807 19:49:49.578180 (+ 2295us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:49.578185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:49.578253 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:49.578382 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:49.580236 (+ 1854us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:49.580243 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:49.580246 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:49.580276 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:49.580339 (+ 63us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:49.580354 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:49.580475 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:49.580717 (+ 242us) server_negotiation.cc:299] Negotiation successful
0807 19:49:49.580790 (+ 73us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":443,"thread_start_us":289,"threads_started":1}
I20260807 19:49:49.582513 29862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.573780 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:35893 (local address 127.12.155.131:41179)
0807 19:49:49.575633 (+ 1853us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:49.575703 (+ 70us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:49.577802 (+ 2099us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:49.578720 (+ 918us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:49.578735 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:49.578892 (+ 157us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:49.579848 (+ 956us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:49:49.579851 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:49.579901 (+ 50us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:49:49.580019 (+ 118us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:49.580463 (+ 444us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:49.580472 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:49.580479 (+ 7us) client_negotiation.cc:769] Sending connection context
0807 19:49:49.580750 (+ 271us) client_negotiation.cc:240] Negotiation successful
0807 19:49:49.581046 (+ 296us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1130,"thread_start_us":881,"threads_started":1}
I20260807 19:49:49.584476 29851 heartbeater.cc:347] Connected to a master server at 127.12.155.190:35893
I20260807 19:49:49.584898 29851 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:49.585786 29851 heartbeater.cc:511] Master 127.12.155.190:35893 requested a full tablet report, sending...
I20260807 19:49:49.587669 29145 ts_manager.cc:194] Registered new tserver with Master: d672c25bfdf140a6979a048a6a01137b (127.12.155.131:39633)
I20260807 19:49:49.592742 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
W20260807 19:49:49.600893 29861 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:49:49.598565 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60028 (local address 127.12.155.190:35893)
0807 19:49:49.598886 (+ 321us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:49.598896 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:49.599561 (+ 665us) server_negotiation.cc:407] Connection header received
0807 19:49:49.599894 (+ 333us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:49.599900 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:49.599974 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:49.600104 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:49.600617 (+ 513us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:60028: BlockingRecv error: recv got EOF from 127.0.0.1:60028 (error 108)
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:49:49.602334 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 29236
I20260807 19:49:49.607301 29870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.603573 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56234 (local address 127.12.155.129:37103)
0807 19:49:49.604328 (+ 755us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:49.604337 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:49.604371 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:49:49.604466 (+ 95us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:49.604475 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:49.604758 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:49.604975 (+ 217us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:49.606388 (+ 1413us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:49.606396 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:49.606410 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:49.606424 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:49.606473 (+ 49us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:49.606490 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:49.606730 (+ 240us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:49.606821 (+ 91us) server_negotiation.cc:299] Negotiation successful
0807 19:49:49.606955 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":553,"thread_start_us":301,"threads_started":1}
I20260807 19:49:49.608929 29423 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:49.698839 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 29236
I20260807 19:49:49.734714 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 29439
I20260807 19:49:49.739539 29873 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.736093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42818 (local address 127.12.155.130:41961)
0807 19:49:49.736717 (+ 624us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:49.736726 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:49.736760 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:49:49.736858 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:49.736865 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:49.737159 (+ 294us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:49.737367 (+ 208us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:49.738619 (+ 1252us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:49.738626 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:49.738641 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:49.738661 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:49.738711 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:49.738734 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:49.738914 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:49.739061 (+ 147us) server_negotiation.cc:299] Negotiation successful
0807 19:49:49.739191 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":454,"thread_start_us":304,"threads_started":1}
I20260807 19:49:49.741159 29640 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:49.830883 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 29439
I20260807 19:49:49.862272 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 29654
I20260807 19:49:49.867779 29875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:49.863810 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56242 (local address 127.12.155.131:39633)
0807 19:49:49.864730 (+ 920us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:49.864740 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:49.864785 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:49:49.864876 (+ 91us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:49.864884 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:49.865192 (+ 308us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:49.865370 (+ 178us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:49.866815 (+ 1445us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:49.866823 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:49.866838 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:49:49.866859 (+ 21us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:49.866911 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:49:49.866928 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:49.867099 (+ 171us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:49.867164 (+ 65us) server_negotiation.cc:299] Negotiation successful
0807 19:49:49.867316 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":716,"thread_start_us":475,"threads_started":1}
I20260807 19:49:49.869464 29841 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:49.960389 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 29654
I20260807 19:49:49.997946 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 29099
I20260807 19:49:49.999878 29190 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:50.120540 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 29099
2026-08-07T19:49:50Z chronyd exiting
[ OK ] SecurityITest.TestRequireEncryptionInsecureCluster (3027 ms)
[ RUN ] SecurityITest.TestRequireAuthenticationSecureCluster
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:49:50 dist-test-slave-2p8l krb5kdc[29883](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:49:50 dist-test-slave-2p8l krb5kdc[29883](info): set up 2 sockets
Aug 07 19:49:50 dist-test-slave-2p8l krb5kdc[29883](info): commencing operation
krb5kdc: starting...
W20260807 19:49:51.616132 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.438s user 0.000s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:49:51 dist-test-slave-2p8l krb5kdc[29883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:49:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:49:51.982508 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40577
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40577
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:52.392334 29911 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:52.392705 29911 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:52.392861 29911 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:52.400622 29911 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:49:52.400738 29911 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:52.400787 29911 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:52.400888 29911 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:49:52.400961 29911 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:49:52.411643 29911 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40577
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40577
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:52.413363 29911 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:52.415151 29911 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:52.428686 29924 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:52.428637 29919 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:52.428732 29921 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:52.430289 29911 server_base.cc:1034] running on GCE node
I20260807 19:49:52.431245 29911 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:52.432952 29911 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:52.434211 29911 hybrid_clock.cc:648] HybridClock initialized: now 1786132192434163 us; error 37 us; skew 500 ppm
I20260807 19:49:52.434644 29911 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:52 dist-test-slave-2p8l krb5kdc[29883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132192, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:52.438625 29911 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:49:52.440613 29911 webserver.cc:460] Webserver started at http://127.12.155.190:34405/ using document root <none> and password file <none>
I20260807 19:49:52.441486 29911 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:52.441644 29911 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:52.442098 29911 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:52.445798 29911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "4b472a69498a4d7d97dbc41b06665dea"
format_stamp: "Formatted at 2026-08-07 19:49:52 on dist-test-slave-2p8l"
server_key: "190da51aadf73324123bf5b223974265"
server_key_iv: "30d79f6b3b6643624e4cd85484e72a98"
server_key_version: "encryptionkey@0"
I20260807 19:49:52.446827 29911 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "4b472a69498a4d7d97dbc41b06665dea"
format_stamp: "Formatted at 2026-08-07 19:49:52 on dist-test-slave-2p8l"
server_key: "190da51aadf73324123bf5b223974265"
server_key_iv: "30d79f6b3b6643624e4cd85484e72a98"
server_key_version: "encryptionkey@0"
I20260807 19:49:52.453217 29911 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:49:52.457414 29937 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:52.459098 29911 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:49:52.459312 29911 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "4b472a69498a4d7d97dbc41b06665dea"
format_stamp: "Formatted at 2026-08-07 19:49:52 on dist-test-slave-2p8l"
server_key: "190da51aadf73324123bf5b223974265"
server_key_iv: "30d79f6b3b6643624e4cd85484e72a98"
server_key_version: "encryptionkey@0"
I20260807 19:49:52.459566 29911 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:52.482443 29911 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:52.487676 29911 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:52.488049 29911 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:52.510272 29911 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:40577
I20260807 19:49:52.510293 30006 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:40577 every 8 connection(s)
I20260807 19:49:52.512019 29911 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:49:52.516697 30009 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:52.521672 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 29911
I20260807 19:49:52.522007 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:49:52.522957 12910 external_mini_cluster.cc:1428] Setting key 33278f3087dd190e3811df9809bd684f
I20260807 19:49:52.531397 30009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea: Bootstrap starting.
I20260807 19:49:52.536131 30009 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:52.537678 30009 log.cc:824] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea: Log is configured to *not* fsync() on all Append() calls
Aug 07 19:49:52 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:52.542325 30009 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea: No bootstrap required, opened a new log
I20260807 19:49:52.551787 30013 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:52.525781 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47626 (local address 127.12.155.190:40577)
0807 19:49:52.526803 (+ 1022us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:52.526824 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:52.526877 (+ 53us) server_negotiation.cc:407] Connection header received
0807 19:49:52.529308 (+ 2431us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:52.529341 (+ 33us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:52.529882 (+ 541us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:52.530354 (+ 472us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:52.532600 (+ 2246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:52.534248 (+ 1648us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:52.536272 (+ 2024us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:52.537107 (+ 835us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:52.537265 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:52.543034 (+ 5769us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:52.543045 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:52.543065 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:52.543108 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:52.546876 (+ 3768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:52.547683 (+ 807us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:52.547692 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:52.547700 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:52.547899 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:52.548363 (+ 464us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:52.548375 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:52.548377 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:52.549043 (+ 666us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:52.549438 (+ 395us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:52.549952 (+ 514us) server_negotiation.cc:299] Negotiation successful
0807 19:49:52.550512 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":774,"thread_start_us":521,"threads_started":1}
I20260807 19:49:52.551506 30009 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b472a69498a4d7d97dbc41b06665dea" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40577 } }
I20260807 19:49:52.552016 30009 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:52.552165 30009 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4b472a69498a4d7d97dbc41b06665dea, State: Initialized, Role: FOLLOWER
I20260807 19:49:52.552917 30009 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b472a69498a4d7d97dbc41b06665dea" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40577 } }
I20260807 19:49:52.553205 30009 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:49:52.553408 30009 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:49:52.553632 30009 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:52.556468 30009 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b472a69498a4d7d97dbc41b06665dea" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40577 } }
I20260807 19:49:52.557083 30009 leader_election.cc:302] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4b472a69498a4d7d97dbc41b06665dea; no voters:
I20260807 19:49:52.557760 30009 leader_election.cc:288] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:49:52.557906 30016 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:52.558772 30016 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [term 1 LEADER]: Becoming Leader. State: Replica: 4b472a69498a4d7d97dbc41b06665dea, State: Running, Role: LEADER
I20260807 19:49:52.559544 30016 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b472a69498a4d7d97dbc41b06665dea" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40577 } }
I20260807 19:49:52.560513 30009 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:49:52.563311 30020 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4b472a69498a4d7d97dbc41b06665dea. Latest consensus state: current_term: 1 leader_uuid: "4b472a69498a4d7d97dbc41b06665dea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b472a69498a4d7d97dbc41b06665dea" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40577 } } }
I20260807 19:49:52.563848 30020 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:52.566023 30028 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:49:52.565887 30017 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4b472a69498a4d7d97dbc41b06665dea" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4b472a69498a4d7d97dbc41b06665dea" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40577 } } }
I20260807 19:49:52.566448 30017 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea [sys.catalog]: This master's current role is: LEADER
I20260807 19:49:52.572485 30028 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:49:52.583699 30028 catalog_manager.cc:1347] Generated new cluster ID: 87ac12fa102d4e48a74daf85ee6de9b7
I20260807 19:49:52.583899 30028 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:49:52.618206 30028 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:49:52.619889 30028 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:49:52.630780 30028 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea: Generated new TSK 0
I20260807 19:49:52.631808 30028 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:49:52.730615 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40577
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:53.166178 30052 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:53.166610 30052 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:53.166823 30052 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:53.175120 30052 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:53.175262 30052 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:53.175458 30052 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:49:53.186789 30052 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:53.188759 30052 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:53.190691 30052 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:53.207114 30057 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:53.207146 30058 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:53.208647 30060 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:53.208981 30052 server_base.cc:1034] running on GCE node
I20260807 19:49:53.209770 30052 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:53.211105 30052 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:53.212327 30052 hybrid_clock.cc:648] HybridClock initialized: now 1786132193212249 us; error 72 us; skew 500 ppm
I20260807 19:49:53.212733 30052 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:53 dist-test-slave-2p8l krb5kdc[29883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132193, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:53.216791 30052 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:49:53.218657 30052 webserver.cc:460] Webserver started at http://127.12.155.129:43555/ using document root <none> and password file <none>
I20260807 19:49:53.219537 30052 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:53.219651 30052 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:53.219974 30052 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:53.223901 30052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "2c9b9a3e46634f1f81f1f0b0090dba19"
format_stamp: "Formatted at 2026-08-07 19:49:53 on dist-test-slave-2p8l"
server_key: "8461f3730cbb633f453dde2794e441dc"
server_key_iv: "690bc699769574771234c7055d2d658b"
server_key_version: "encryptionkey@0"
I20260807 19:49:53.224985 30052 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "2c9b9a3e46634f1f81f1f0b0090dba19"
format_stamp: "Formatted at 2026-08-07 19:49:53 on dist-test-slave-2p8l"
server_key: "8461f3730cbb633f453dde2794e441dc"
server_key_iv: "690bc699769574771234c7055d2d658b"
server_key_version: "encryptionkey@0"
I20260807 19:49:53.231549 30052 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.004s sys 0.004s
I20260807 19:49:53.235942 30069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:53.237715 30052 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.001s sys 0.000s
I20260807 19:49:53.237974 30052 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "2c9b9a3e46634f1f81f1f0b0090dba19"
format_stamp: "Formatted at 2026-08-07 19:49:53 on dist-test-slave-2p8l"
server_key: "8461f3730cbb633f453dde2794e441dc"
server_key_iv: "690bc699769574771234c7055d2d658b"
server_key_version: "encryptionkey@0"
I20260807 19:49:53.238314 30052 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:53.260597 30052 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:53.266533 30052 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:53.266945 30052 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:53.268409 30052 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:53.270349 30052 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:53.270437 30052 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:53.270622 30052 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:53.270694 30052 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:53.310557 30052 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:32949
I20260807 19:49:53.310597 30240 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:32949 every 8 connection(s)
I20260807 19:49:53.312354 30052 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:49:53.321853 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 30052
I20260807 19:49:53.322175 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:49:53.323163 12910 external_mini_cluster.cc:1428] Setting key ae4bd959269149156f17f40dbece6bf6
Aug 07 19:49:53 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132193, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:53.337646 30244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:53.315685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:33577 (local address 127.12.155.190:40577)
0807 19:49:53.316277 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:53.316282 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:53.317216 (+ 934us) server_negotiation.cc:407] Connection header received
0807 19:49:53.319420 (+ 2204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:53.319427 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:53.319534 (+ 107us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:53.319674 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:53.321567 (+ 1893us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:53.322664 (+ 1097us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:53.324888 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:53.325382 (+ 494us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:53.325547 (+ 165us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:53.329656 (+ 4109us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:53.329665 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:53.329673 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:53.329724 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:53.333789 (+ 4065us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:53.334687 (+ 898us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:53.334695 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:53.334701 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:53.334887 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:53.335339 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:53.335346 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:53.335352 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:53.335815 (+ 463us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:53.335985 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:53.336798 (+ 813us) server_negotiation.cc:299] Negotiation successful
0807 19:49:53.337105 (+ 307us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":465,"thread_start_us":319,"threads_started":1}
I20260807 19:49:53.338692 30250 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:53.316193 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40577 (local address 127.12.155.129:33577)
0807 19:49:53.317023 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:53.317077 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:53.319089 (+ 2012us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:53.319950 (+ 861us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:53.319959 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:53.320567 (+ 608us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:53.321345 (+ 778us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:53.321377 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:53.322857 (+ 1480us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:53.322863 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:53.324743 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:53.324758 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:53.325681 (+ 923us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:53.325692 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:53.326005 (+ 313us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:53.326885 (+ 880us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:53.326916 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:53.329389 (+ 2473us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:53.333961 (+ 4572us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:53.333970 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:53.333989 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:53.334560 (+ 571us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:53.335004 (+ 444us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:53.335007 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:53.335010 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:53.335216 (+ 206us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:53.335945 (+ 729us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:53.335952 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:53.336365 (+ 413us) client_negotiation.cc:769] Sending connection context
0807 19:49:53.336630 (+ 265us) client_negotiation.cc:240] Negotiation successful
0807 19:49:53.337145 (+ 515us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":556,"thread_start_us":320,"threads_started":1}
I20260807 19:49:53.340720 30241 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40577
I20260807 19:49:53.341150 30241 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:53.342267 30241 heartbeater.cc:511] Master 127.12.155.190:40577 requested a full tablet report, sending...
I20260807 19:49:53.345186 29959 ts_manager.cc:194] Registered new tserver with Master: 2c9b9a3e46634f1f81f1f0b0090dba19 (127.12.155.129:32949)
I20260807 19:49:53.347082 29959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:33577
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:49:53.405869 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40577
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:49:53.831213 30255 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:53.831672 30255 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:53.831867 30255 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:53.840301 30255 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:53.840490 30255 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:53.840693 30255 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:49:53.852632 30255 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:53.854650 30255 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:53.856475 30255 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:53.873193 30268 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:53.873694 30269 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:53.873731 30275 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:53.875341 30255 server_base.cc:1034] running on GCE node
I20260807 19:49:53.876202 30255 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:53.877523 30255 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:53.878762 30255 hybrid_clock.cc:648] HybridClock initialized: now 1786132193878698 us; error 55 us; skew 500 ppm
I20260807 19:49:53.879220 30255 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:53 dist-test-slave-2p8l krb5kdc[29883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132193, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:53.883446 30255 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:49:53.885768 30255 webserver.cc:460] Webserver started at http://127.12.155.130:34173/ using document root <none> and password file <none>
I20260807 19:49:53.886854 30255 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:53.887013 30255 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:53.887420 30255 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:53.891305 30255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "2a14047ba0194f2fa995fcc21e1554dc"
format_stamp: "Formatted at 2026-08-07 19:49:53 on dist-test-slave-2p8l"
server_key: "4bb969417cde9058d42897954453b295"
server_key_iv: "6f1a43593f2c621e68f2602352c94521"
server_key_version: "encryptionkey@0"
I20260807 19:49:53.892273 30255 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "2a14047ba0194f2fa995fcc21e1554dc"
format_stamp: "Formatted at 2026-08-07 19:49:53 on dist-test-slave-2p8l"
server_key: "4bb969417cde9058d42897954453b295"
server_key_iv: "6f1a43593f2c621e68f2602352c94521"
server_key_version: "encryptionkey@0"
I20260807 19:49:53.899063 30255 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.001s
I20260807 19:49:53.903419 30286 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:53.905171 30255 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:49:53.905390 30255 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "2a14047ba0194f2fa995fcc21e1554dc"
format_stamp: "Formatted at 2026-08-07 19:49:53 on dist-test-slave-2p8l"
server_key: "4bb969417cde9058d42897954453b295"
server_key_iv: "6f1a43593f2c621e68f2602352c94521"
server_key_version: "encryptionkey@0"
I20260807 19:49:53.905640 30255 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:53.937044 30255 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:53.942620 30255 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:53.942997 30255 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:53.944289 30255 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:53.946149 30255 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:53.946251 30255 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 19:49:53.946363 30255 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:53.946411 30255 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:53.986647 30255 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:45709
I20260807 19:49:53.986704 30461 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:45709 every 8 connection(s)
I20260807 19:49:53.988281 30255 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:49:53.998364 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 30255
I20260807 19:49:53.998633 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:49:53.999179 12910 external_mini_cluster.cc:1428] Setting key 6193436b56f4ba72fe02bdbf6e7998bf
Aug 07 19:49:54 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132193, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:54.013729 30464 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:53.991689 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:45213 (local address 127.12.155.190:40577)
0807 19:49:53.992231 (+ 542us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:53.992237 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:53.993487 (+ 1250us) server_negotiation.cc:407] Connection header received
0807 19:49:53.995958 (+ 2471us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:53.995965 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:53.996077 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:53.996225 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:53.998160 (+ 1935us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:53.999123 (+ 963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.001037 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.001628 (+ 591us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.001770 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.006488 (+ 4718us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:54.006494 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:54.006498 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:54.006538 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:54.009568 (+ 3030us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:54.010807 (+ 1239us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:54.010815 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:54.010819 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:54.011026 (+ 207us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:54.011588 (+ 562us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:54.011591 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:54.011593 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:54.011966 (+ 373us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:54.012091 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.013201 (+ 1110us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.013418 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":401,"thread_start_us":268,"threads_started":1}
I20260807 19:49:54.015774 30465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:53.992403 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40577 (local address 127.12.155.130:45213)
0807 19:49:53.993270 (+ 867us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:53.993325 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:53.995600 (+ 2275us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:53.996552 (+ 952us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:53.996562 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:53.997187 (+ 625us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:53.997916 (+ 729us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:53.997935 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:53.999317 (+ 1382us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:53.999325 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.000882 (+ 1557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.000895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.001901 (+ 1006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.001910 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.002293 (+ 383us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.003239 (+ 946us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:54.003266 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:54.006202 (+ 2936us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:54.009786 (+ 3584us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:54.009802 (+ 16us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:54.009829 (+ 27us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:54.010652 (+ 823us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:54.011159 (+ 507us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:54.011167 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:54.011174 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:54.011467 (+ 293us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:54.012118 (+ 651us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:54.012131 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:54.012716 (+ 585us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.013115 (+ 399us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.013870 (+ 755us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":590,"thread_start_us":329,"threads_started":1}
I20260807 19:49:54.017638 30462 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40577
I20260807 19:49:54.018154 30462 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:54.019328 30462 heartbeater.cc:511] Master 127.12.155.190:40577 requested a full tablet report, sending...
I20260807 19:49:54.021368 29959 ts_manager.cc:194] Registered new tserver with Master: 2a14047ba0194f2fa995fcc21e1554dc (127.12.155.130:45709)
I20260807 19:49:54.022487 29959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:45213
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:49:54.082966 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40577
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:44295
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:49:54.351003 30241 heartbeater.cc:503] Master 127.12.155.190:40577 was elected leader, sending a full tablet report...
W20260807 19:49:54.514659 30470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:49:54.515102 30470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:49:54.515290 30470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:49:54.523698 30470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:49:54.523901 30470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:49:54.524096 30470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:49:54.535650 30470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44295
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40577
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:49:54.537566 30470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:49:54.539407 30470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:49:54.555142 30479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:54.555176 30483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:49:54.555230 30481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:49:54.556598 30470 server_base.cc:1034] running on GCE node
I20260807 19:49:54.557447 30470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:49:54.558732 30470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:49:54.560021 30470 hybrid_clock.cc:648] HybridClock initialized: now 1786132194559961 us; error 59 us; skew 500 ppm
I20260807 19:49:54.560405 30470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:49:54 dist-test-slave-2p8l krb5kdc[29883](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:49:54.564564 30470 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:49:54.566588 30470 webserver.cc:460] Webserver started at http://127.12.155.131:39873/ using document root <none> and password file <none>
I20260807 19:49:54.567584 30470 fs_manager.cc:359] Metadata directory not provided
I20260807 19:49:54.567765 30470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:49:54.568370 30470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:49:54.572633 30470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "ac0525d7153e44f68d5d72dd2be24510"
format_stamp: "Formatted at 2026-08-07 19:49:54 on dist-test-slave-2p8l"
server_key: "642e447713988204d435fa46cf73fe54"
server_key_iv: "b42470677cfaa32d350ad81b300d3a05"
server_key_version: "encryptionkey@0"
I20260807 19:49:54.573693 30470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "ac0525d7153e44f68d5d72dd2be24510"
format_stamp: "Formatted at 2026-08-07 19:49:54 on dist-test-slave-2p8l"
server_key: "642e447713988204d435fa46cf73fe54"
server_key_iv: "b42470677cfaa32d350ad81b300d3a05"
server_key_version: "encryptionkey@0"
I20260807 19:49:54.580891 30470 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.005s sys 0.000s
I20260807 19:49:54.586143 30492 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:54.588335 30470 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:49:54.588634 30470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "ac0525d7153e44f68d5d72dd2be24510"
format_stamp: "Formatted at 2026-08-07 19:49:54 on dist-test-slave-2p8l"
server_key: "642e447713988204d435fa46cf73fe54"
server_key_iv: "b42470677cfaa32d350ad81b300d3a05"
server_key_version: "encryptionkey@0"
I20260807 19:49:54.588959 30470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:49:54.614794 30470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:49:54.620766 30470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:49:54.621177 30470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:49:54.622480 30470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:49:54.624274 30470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:49:54.624394 30470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:54.624600 30470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:49:54.624683 30470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:49:54.667117 30470 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:37717
I20260807 19:49:54.667160 30682 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:37717 every 8 connection(s)
I20260807 19:49:54.669126 30470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:49:54.675439 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 30470
I20260807 19:49:54.675707 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:49:54.676265 12910 external_mini_cluster.cc:1428] Setting key 4e046e5d39b2a82efe1fd06ce559d47e
Aug 07 19:49:54 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132194, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:49:54.695006 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.672890 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:39751 (local address 127.12.155.190:40577)
0807 19:49:54.673548 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.673554 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.674615 (+ 1061us) server_negotiation.cc:407] Connection header received
0807 19:49:54.677395 (+ 2780us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.677402 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.677551 (+ 149us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.677699 (+ 148us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:54.679781 (+ 2082us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.680773 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.682571 (+ 1798us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.683022 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.683170 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.687331 (+ 4161us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:54.687337 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:54.687341 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:54.687382 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:54.690950 (+ 3568us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:54.691938 (+ 988us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:54.691943 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:54.691946 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:54.692110 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:54.692676 (+ 566us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:54.692680 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:54.692682 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:54.693107 (+ 425us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:54.693312 (+ 205us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.694362 (+ 1050us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.694619 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":520,"thread_start_us":347,"threads_started":1}
I20260807 19:49:54.696458 30691 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.673444 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40577 (local address 127.12.155.131:39751)
0807 19:49:54.674418 (+ 974us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:54.674466 (+ 48us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:54.676980 (+ 2514us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:54.678017 (+ 1037us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:54.678031 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:54.678864 (+ 833us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:49:54.679579 (+ 715us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.679598 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.680954 (+ 1356us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.680958 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.682409 (+ 1451us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.682422 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.683287 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.683298 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.683587 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.684443 (+ 856us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:49:54.684484 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:49:54.687060 (+ 2576us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:49:54.691140 (+ 4080us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:54.691155 (+ 15us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:54.691181 (+ 26us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:54.691777 (+ 596us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:54.692245 (+ 468us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:49:54.692250 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:49:54.692263 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:49:54.692526 (+ 263us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:49:54.693261 (+ 735us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:49:54.693272 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:49:54.693825 (+ 553us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.694242 (+ 417us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.694893 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":681,"thread_start_us":349,"threads_started":1}
I20260807 19:49:54.698553 30685 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40577
I20260807 19:49:54.698997 30685 heartbeater.cc:464] Registering TS with master...
I20260807 19:49:54.700047 30685 heartbeater.cc:511] Master 127.12.155.190:40577 requested a full tablet report, sending...
I20260807 19:49:54.702190 29959 ts_manager.cc:194] Registered new tserver with Master: ac0525d7153e44f68d5d72dd2be24510 (127.12.155.131:37717)
I20260807 19:49:54.703207 29959 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:39751
I20260807 19:49:54.706645 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:49:54.728436 30689 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.712158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47642 (local address 127.12.155.190:40577)
0807 19:49:54.712360 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.712365 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.713041 (+ 676us) server_negotiation.cc:407] Connection header received
0807 19:49:54.713206 (+ 165us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.713210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.713342 (+ 132us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.713441 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:54.715288 (+ 1847us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.716118 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.717844 (+ 1726us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.718537 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.718656 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.721422 (+ 2766us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:54.721428 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:54.721432 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:54.721485 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:54.725012 (+ 3527us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:54.725884 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:54.725893 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:54.725898 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:54.726170 (+ 272us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:54.726640 (+ 470us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:54.726645 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:54.726647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:54.727133 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:54.727366 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.727906 (+ 540us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.728144 (+ 238us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:49:54.734299 29959 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47642:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:49:54.742571 29959 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:49:54.776244 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.759762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:37717 (local address 127.0.0.1:35260)
0807 19:49:54.764469 (+ 4707us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:54.764493 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:54.764676 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:54.766043 (+ 1367us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:54.766048 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:54.766106 (+ 58us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:54.766739 (+ 633us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.766768 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.769166 (+ 2398us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.769171 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.771945 (+ 2774us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.771963 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.774796 (+ 2833us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.774802 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.775092 (+ 290us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.775207 (+ 115us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.775394 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.775650 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4545,"mutex_wait_us":175,"thread_start_us":4353,"threads_started":1}
I20260807 19:49:54.776808 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.759801 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40022 (local address 127.12.155.130:45709)
0807 19:49:54.763989 (+ 4188us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.764001 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.764042 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:49:54.764220 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.764231 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.764730 (+ 499us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.766000 (+ 1270us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:54.766409 (+ 409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.768471 (+ 2062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.772177 (+ 3706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.774103 (+ 1926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.774317 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.774563 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.776157 (+ 1594us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.776424 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":3982,"thread_start_us":3804,"threads_started":1}
I20260807 19:49:54.776842 30711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.760662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35260 (local address 127.12.155.131:37717)
0807 19:49:54.763362 (+ 2700us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.763379 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.764853 (+ 1474us) server_negotiation.cc:407] Connection header received
0807 19:49:54.764995 (+ 142us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.765004 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.765381 (+ 377us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.765642 (+ 261us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:54.767004 (+ 1362us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.768967 (+ 1963us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.772176 (+ 3209us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.774103 (+ 1927us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.774333 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.774563 (+ 230us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.775871 (+ 1308us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.776177 (+ 306us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2370,"thread_start_us":2850,"threads_started":1}
I20260807 19:49:54.778522 30708 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.759543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:45709 (local address 127.0.0.1:40022)
0807 19:49:54.760663 (+ 1120us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:54.760727 (+ 64us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:54.760961 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:54.765029 (+ 4068us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:54.765038 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:54.765074 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:54.765715 (+ 641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.765737 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.768650 (+ 2913us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.768657 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.771945 (+ 3288us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.771963 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.774751 (+ 2788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.774761 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.775889 (+ 1128us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.775935 (+ 46us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.777091 (+ 1156us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.777301 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":750,"mutex_wait_us":834,"thread_start_us":555,"threads_started":1}
I20260807 19:49:54.783375 30365 tablet_service.cc:1467] Processing CreateTablet for tablet 003de4cd87754ce0901de800e7103d38 (DEFAULT_TABLE table=test-table [id=cd0c53cfe3434c7b96e282af7c4a6825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:54.783241 30575 tablet_service.cc:1467] Processing CreateTablet for tablet 003de4cd87754ce0901de800e7103d38 (DEFAULT_TABLE table=test-table [id=cd0c53cfe3434c7b96e282af7c4a6825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:54.785354 30575 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 003de4cd87754ce0901de800e7103d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:54.785351 30365 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 003de4cd87754ce0901de800e7103d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:54.787113 30709 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.762831 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:32949 (local address 127.0.0.1:41180)
0807 19:49:54.777404 (+ 14573us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:54.777433 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:54.777579 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:54.778537 (+ 958us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:54.778543 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:54.778574 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:54.778903 (+ 329us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.778920 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.781292 (+ 2372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.781299 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.783372 (+ 2073us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.783392 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.786084 (+ 2692us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.786093 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.786356 (+ 263us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.786399 (+ 43us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.786523 (+ 124us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.786724 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14030,"thread_start_us":16411,"threads_started":1}
I20260807 19:49:54.787220 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.763240 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41180 (local address 127.12.155.129:32949)
0807 19:49:54.775774 (+ 12534us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.775787 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.777566 (+ 1779us) server_negotiation.cc:407] Connection header received
0807 19:49:54.777771 (+ 205us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.777780 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.778230 (+ 450us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.778858 (+ 628us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:54.779237 (+ 379us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.781106 (+ 1869us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.783612 (+ 2506us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.785431 (+ 1819us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.785690 (+ 259us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.785921 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.786604 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.786818 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12283,"thread_start_us":12056,"threads_started":1}
I20260807 19:49:54.792836 30152 tablet_service.cc:1467] Processing CreateTablet for tablet 003de4cd87754ce0901de800e7103d38 (DEFAULT_TABLE table=test-table [id=cd0c53cfe3434c7b96e282af7c4a6825]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:49:54.795384 30152 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 003de4cd87754ce0901de800e7103d38. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:49:54.800139 30716 tablet_bootstrap.cc:492] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Bootstrap starting.
I20260807 19:49:54.804021 30718 tablet_bootstrap.cc:492] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Bootstrap starting.
I20260807 19:49:54.805735 30716 tablet_bootstrap.cc:654] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:54.807574 30716 log.cc:824] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:54.809444 30718 tablet_bootstrap.cc:654] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:54.811195 30718 log.cc:824] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:54.812371 30716 tablet_bootstrap.cc:492] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: No bootstrap required, opened a new log
I20260807 19:49:54.812770 30716 ts_tablet_manager.cc:1397] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Time spent bootstrapping tablet: real 0.013s user 0.008s sys 0.001s
I20260807 19:49:54.815668 30724 tablet_bootstrap.cc:492] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Bootstrap starting.
I20260807 19:49:54.816082 30718 tablet_bootstrap.cc:492] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: No bootstrap required, opened a new log
I20260807 19:49:54.816547 30718 ts_tablet_manager.cc:1397] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Time spent bootstrapping tablet: real 0.013s user 0.007s sys 0.004s
I20260807 19:49:54.820603 30724 tablet_bootstrap.cc:654] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Neither blocks nor log segments found. Creating new log.
I20260807 19:49:54.822433 30724 log.cc:824] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Log is configured to *not* fsync() on all Append() calls
I20260807 19:49:54.825237 30716 raft_consensus.cc:348] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.825730 30716 raft_consensus.cc:374] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:54.825876 30716 raft_consensus.cc:729] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2a14047ba0194f2fa995fcc21e1554dc, State: Initialized, Role: FOLLOWER
I20260807 19:49:54.826871 30716 consensus_queue.cc:260] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.827317 30724 tablet_bootstrap.cc:492] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: No bootstrap required, opened a new log
I20260807 19:49:54.827353 30718 raft_consensus.cc:348] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.827760 30724 ts_tablet_manager.cc:1397] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Time spent bootstrapping tablet: real 0.012s user 0.007s sys 0.004s
I20260807 19:49:54.827996 30718 raft_consensus.cc:374] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:54.828159 30718 raft_consensus.cc:729] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ac0525d7153e44f68d5d72dd2be24510, State: Initialized, Role: FOLLOWER
I20260807 19:49:54.828986 30718 consensus_queue.cc:260] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.831245 30685 heartbeater.cc:503] Master 127.12.155.190:40577 was elected leader, sending a full tablet report...
I20260807 19:49:54.831643 30716 ts_tablet_manager.cc:1428] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Time spent starting tablet: real 0.019s user 0.016s sys 0.001s
I20260807 19:49:54.832001 30718 ts_tablet_manager.cc:1428] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Time spent starting tablet: real 0.015s user 0.008s sys 0.006s
I20260807 19:49:54.832561 30462 heartbeater.cc:503] Master 127.12.155.190:40577 was elected leader, sending a full tablet report...
I20260807 19:49:54.840495 30724 raft_consensus.cc:348] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.841079 30724 raft_consensus.cc:374] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:49:54.841226 30724 raft_consensus.cc:729] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c9b9a3e46634f1f81f1f0b0090dba19, State: Initialized, Role: FOLLOWER
I20260807 19:49:54.842052 30724 consensus_queue.cc:260] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.844851 30724 ts_tablet_manager.cc:1428] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Time spent starting tablet: real 0.017s user 0.012s sys 0.003s
W20260807 19:49:54.921499 30687 tablet.cc:2369] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:54.941071 30729 raft_consensus.cc:482] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:49:54.941516 30729 raft_consensus.cc:504] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.944360 30729 leader_election.cc:288] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 2a14047ba0194f2fa995fcc21e1554dc (127.12.155.130:45709), ac0525d7153e44f68d5d72dd2be24510 (127.12.155.131:37717)
I20260807 19:49:54.952284 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.945009 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51597 (local address 127.12.155.130:45709)
0807 19:49:54.945396 (+ 387us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.945407 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.946040 (+ 633us) server_negotiation.cc:407] Connection header received
0807 19:49:54.946388 (+ 348us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.946393 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.946473 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.946601 (+ 128us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:54.947267 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.948059 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.950188 (+ 2129us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.951094 (+ 906us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.951324 (+ 230us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.951420 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.951751 (+ 331us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.951906 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":112}
I20260807 19:49:54.952464 30711 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.945137 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:58583 (local address 127.12.155.131:37717)
0807 19:49:54.945667 (+ 530us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:54.945677 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:54.946468 (+ 791us) server_negotiation.cc:407] Connection header received
0807 19:49:54.946718 (+ 250us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:54.946722 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:54.946811 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:54.946924 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:49:54.947573 (+ 649us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.948374 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.950478 (+ 2104us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.951370 (+ 892us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.951580 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.951678 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:54.951985 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 19:49:54.952139 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":312}
I20260807 19:49:54.952517 30730 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.944743 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:45709 (local address 127.12.155.129:51597)
0807 19:49:54.945887 (+ 1144us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:54.945906 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:54.946187 (+ 281us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:54.946622 (+ 435us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:54.946628 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:54.946655 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:54.947073 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.947083 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.948204 (+ 1121us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.948212 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.949970 (+ 1758us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.949984 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.951343 (+ 1359us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.951357 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.951541 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.951574 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.951708 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.951905 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":961,"mutex_wait_us":6,"thread_start_us":705,"threads_started":1}
I20260807 19:49:54.952606 30733 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:54.944744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:37717 (local address 127.12.155.129:58583)
0807 19:49:54.946329 (+ 1585us) negotiation.cc:107] Waiting for socket to connect
0807 19:49:54.946344 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:49:54.946541 (+ 197us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:49:54.946951 (+ 410us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:49:54.946956 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:49:54.946980 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:49:54.947401 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.947409 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.948542 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.948549 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.950302 (+ 1753us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:49:54.950315 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:49:54.951627 (+ 1312us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:49:54.951634 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:49:54.951815 (+ 181us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:54.951840 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:49:54.951953 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 19:49:54.952097 (+ 144us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1397,"thread_start_us":1087,"threads_started":1}
I20260807 19:49:54.954128 30396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003de4cd87754ce0901de800e7103d38" candidate_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a14047ba0194f2fa995fcc21e1554dc" is_pre_election: true
I20260807 19:49:54.954154 30605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003de4cd87754ce0901de800e7103d38" candidate_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac0525d7153e44f68d5d72dd2be24510" is_pre_election: true
I20260807 19:49:54.954845 30605 raft_consensus.cc:2454] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9b9a3e46634f1f81f1f0b0090dba19 in term 0.
I20260807 19:49:54.954850 30396 raft_consensus.cc:2454] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 2c9b9a3e46634f1f81f1f0b0090dba19 in term 0.
I20260807 19:49:54.955801 30076 leader_election.cc:302] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 2a14047ba0194f2fa995fcc21e1554dc, 2c9b9a3e46634f1f81f1f0b0090dba19; no voters:
I20260807 19:49:54.956403 30729 raft_consensus.cc:2781] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:49:54.956705 30729 raft_consensus.cc:482] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:49:54.956854 30729 raft_consensus.cc:3037] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:54.959961 30729 raft_consensus.cc:504] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.960877 30729 leader_election.cc:288] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [CANDIDATE]: Term 1 election: Requested vote from peers 2a14047ba0194f2fa995fcc21e1554dc (127.12.155.130:45709), ac0525d7153e44f68d5d72dd2be24510 (127.12.155.131:37717)
I20260807 19:49:54.961745 30396 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003de4cd87754ce0901de800e7103d38" candidate_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2a14047ba0194f2fa995fcc21e1554dc"
I20260807 19:49:54.961746 30605 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "003de4cd87754ce0901de800e7103d38" candidate_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ac0525d7153e44f68d5d72dd2be24510"
I20260807 19:49:54.962122 30396 raft_consensus.cc:3037] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:54.962122 30605 raft_consensus.cc:3037] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:49:54.966557 30396 raft_consensus.cc:2454] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9b9a3e46634f1f81f1f0b0090dba19 in term 1.
I20260807 19:49:54.966557 30605 raft_consensus.cc:2454] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 2c9b9a3e46634f1f81f1f0b0090dba19 in term 1.
I20260807 19:49:54.967391 30076 leader_election.cc:302] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 2a14047ba0194f2fa995fcc21e1554dc, 2c9b9a3e46634f1f81f1f0b0090dba19, ac0525d7153e44f68d5d72dd2be24510; no voters:
I20260807 19:49:54.967870 30729 raft_consensus.cc:2781] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:49:54.968439 30729 raft_consensus.cc:686] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 1 LEADER]: Becoming Leader. State: Replica: 2c9b9a3e46634f1f81f1f0b0090dba19, State: Running, Role: LEADER
I20260807 19:49:54.969239 30729 consensus_queue.cc:237] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } }
I20260807 19:49:54.976403 29959 catalog_manager.cc:5495] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 reported cstate change: term changed from 0 to 1, leader changed from <none> to 2c9b9a3e46634f1f81f1f0b0090dba19 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "2c9b9a3e46634f1f81f1f0b0090dba19" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 32949 } health_report { overall_health: HEALTHY } } }
W20260807 19:49:54.991076 30463 tablet.cc:2369] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:49:55.023967 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:55.017411 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41192 (local address 127.12.155.129:32949)
0807 19:49:55.017689 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:55.017696 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:55.017721 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:49:55.018039 (+ 318us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:55.018043 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:55.018252 (+ 209us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:55.018453 (+ 201us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:49:55.018903 (+ 450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.019713 (+ 810us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.021236 (+ 1523us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.021682 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.021846 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:55.022539 (+ 693us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:49:55.023263 (+ 724us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:49:55.023457 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:55.023513 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 19:49:55.023626 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 19:49:55.035486 30396 raft_consensus.cc:1261] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 1 FOLLOWER]: Refusing update from remote peer 2c9b9a3e46634f1f81f1f0b0090dba19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:55.035486 30605 raft_consensus.cc:1261] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 1 FOLLOWER]: Refusing update from remote peer 2c9b9a3e46634f1f81f1f0b0090dba19: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:49:55.036968 30729 consensus_queue.cc:1035] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ac0525d7153e44f68d5d72dd2be24510" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 37717 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:55.037415 30734 consensus_queue.cc:1035] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2a14047ba0194f2fa995fcc21e1554dc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45709 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:49:55.062892 30744 mvcc.cc:205] Tried to move back new op lower bound from 7315997470850138112 to 7315997470599700480. Current Snapshot: MvccSnapshot[applied={T|T < 7315997470850138112}]
I20260807 19:49:55.079030 29958 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:55.079459 29958 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:47642:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:49:55.084743 29958 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 4b472a69498a4d7d97dbc41b06665dea: Sending DeleteTablet for 3 replicas of tablet 003de4cd87754ce0901de800e7103d38
I20260807 19:49:55.086489 30575 tablet_service.cc:1514] Processing DeleteTablet for tablet 003de4cd87754ce0901de800e7103d38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:55 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:35260
I20260807 19:49:55.086549 30365 tablet_service.cc:1514] Processing DeleteTablet for tablet 003de4cd87754ce0901de800e7103d38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:55 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:40022
I20260807 19:49:55.087985 30152 tablet_service.cc:1514] Processing DeleteTablet for tablet 003de4cd87754ce0901de800e7103d38 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:49:55 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:41180
I20260807 19:49:55.088779 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 30052
I20260807 19:49:55.097373 30759 tablet_replica.cc:330] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: stopping tablet replica
I20260807 19:49:55.098043 30759 raft_consensus.cc:2229] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:55.100117 30759 raft_consensus.cc:2258] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:55.104174 30759 ts_tablet_manager.cc:1905] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:55.106448 30760 tablet_replica.cc:330] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: stopping tablet replica
I20260807 19:49:55.107232 30760 raft_consensus.cc:2229] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:49:55.108486 30758 tablet_replica.cc:330] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: stopping tablet replica
I20260807 19:49:55.108963 30758 raft_consensus.cc:2229] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:49:55.109645 30758 raft_consensus.cc:2258] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:55.110986 30760 raft_consensus.cc:2258] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:49:55.113088 30759 ts_tablet_manager.cc:1918] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:55.113363 30759 log.cc:1196] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/003de4cd87754ce0901de800e7103d38
I20260807 19:49:55.113811 30760 ts_tablet_manager.cc:1905] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:55.114248 30759 ts_tablet_manager.cc:1939] T 003de4cd87754ce0901de800e7103d38 P ac0525d7153e44f68d5d72dd2be24510: Deleting consensus metadata
I20260807 19:49:55.115588 30758 ts_tablet_manager.cc:1905] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:49:55.116863 29941 catalog_manager.cc:4841] TS ac0525d7153e44f68d5d72dd2be24510 (127.12.155.131:37717): tablet 003de4cd87754ce0901de800e7103d38 (table test-table [id=cd0c53cfe3434c7b96e282af7c4a6825]) successfully deleted
Aug 07 19:49:55 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:49:55.122571 30760 ts_tablet_manager.cc:1918] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:55.122838 30760 log.cc:1196] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/003de4cd87754ce0901de800e7103d38
I20260807 19:49:55.123616 30760 ts_tablet_manager.cc:1939] T 003de4cd87754ce0901de800e7103d38 P 2c9b9a3e46634f1f81f1f0b0090dba19: Deleting consensus metadata
I20260807 19:49:55.125198 30758 ts_tablet_manager.cc:1918] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:49:55.125439 30758 log.cc:1196] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestRequireAuthenticationSecureCluster.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/003de4cd87754ce0901de800e7103d38
I20260807 19:49:55.126106 30758 ts_tablet_manager.cc:1939] T 003de4cd87754ce0901de800e7103d38 P 2a14047ba0194f2fa995fcc21e1554dc: Deleting consensus metadata
I20260807 19:49:55.126439 29939 catalog_manager.cc:4841] TS 2c9b9a3e46634f1f81f1f0b0090dba19 (127.12.155.129:32949): tablet 003de4cd87754ce0901de800e7103d38 (table test-table [id=cd0c53cfe3434c7b96e282af7c4a6825]) successfully deleted
I20260807 19:49:55.128542 29940 catalog_manager.cc:4841] TS 2a14047ba0194f2fa995fcc21e1554dc (127.12.155.130:45709): tablet 003de4cd87754ce0901de800e7103d38 (table test-table [id=cd0c53cfe3434c7b96e282af7c4a6825]) successfully deleted
I20260807 19:49:55.130743 30715 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:55.090791 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41208 (local address 127.12.155.129:32949)
0807 19:49:55.091067 (+ 276us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:55.091077 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:55.102094 (+ 11017us) server_negotiation.cc:407] Connection header received
0807 19:49:55.102801 (+ 707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:55.102810 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:55.102963 (+ 153us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:55.103087 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:55.107619 (+ 4532us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.108990 (+ 1371us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.111093 (+ 2103us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.111837 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.111978 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:55.121951 (+ 9973us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:55.121969 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:55.121992 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:55.122098 (+ 106us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:55.127268 (+ 5170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:55.128153 (+ 885us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:55.128185 (+ 32us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:55.128192 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:55.128413 (+ 221us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:55.128950 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:55.128954 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:55.128956 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:55.129405 (+ 449us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:55.129649 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:55.130181 (+ 532us) server_negotiation.cc:299] Negotiation successful
0807 19:49:55.130402 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":93}
I20260807 19:49:55.131758 30235 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:55.260867 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 30052
I20260807 19:49:55.302982 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 30255
Aug 07 19:49:55 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:49:55.320973 30710 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:55.304109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40038 (local address 127.12.155.130:45709)
0807 19:49:55.304350 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:55.304362 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:55.304384 (+ 22us) server_negotiation.cc:407] Connection header received
0807 19:49:55.304544 (+ 160us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:55.304548 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:55.304626 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:55.304717 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:55.306296 (+ 1579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.307181 (+ 885us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.308755 (+ 1574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.309188 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.309337 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:55.314519 (+ 5182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:55.314540 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:55.314562 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:55.314612 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:55.318012 (+ 3400us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:55.318804 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:55.318814 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:55.318816 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:55.318975 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:55.319335 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:55.319338 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:55.319340 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:55.319762 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:55.320053 (+ 291us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:55.320277 (+ 224us) server_negotiation.cc:299] Negotiation successful
0807 19:49:55.320498 (+ 221us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 19:49:55.321794 30457 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:55.423130 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 30255
I20260807 19:49:55.457387 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 30470
Aug 07 19:49:55 dist-test-slave-2p8l krb5kdc[29883](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132191, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:49:55.476421 30766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:49:55.458578 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:35274 (local address 127.12.155.131:37717)
0807 19:49:55.459388 (+ 810us) server_negotiation.cc:206] Beginning negotiation
0807 19:49:55.459393 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:49:55.459412 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:49:55.459484 (+ 72us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:49:55.459488 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:49:55.459563 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:49:55.459665 (+ 102us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:49:55.461323 (+ 1658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.462449 (+ 1126us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.463894 (+ 1445us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:49:55.464545 (+ 651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:49:55.464657 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:49:55.470041 (+ 5384us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:49:55.470154 (+ 113us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:49:55.470179 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:49:55.470237 (+ 58us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:49:55.473441 (+ 3204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:55.474250 (+ 809us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:55.474260 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:55.474264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:55.474418 (+ 154us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:49:55.474829 (+ 411us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:49:55.474833 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:49:55.474835 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:49:55.475273 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:49:55.475548 (+ 275us) server_negotiation.cc:1035] Waiting for connection context
0807 19:49:55.475863 (+ 315us) server_negotiation.cc:299] Negotiation successful
0807 19:49:55.476073 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":688,"thread_start_us":536,"threads_started":1}
I20260807 19:49:55.477344 30670 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:55.576996 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 30470
I20260807 19:49:55.600945 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 29911
I20260807 19:49:55.602770 30000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:49:55.738283 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 29911
2026-08-07T19:49:55Z chronyd exiting
[ OK ] SecurityITest.TestRequireAuthenticationSecureCluster (5622 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegration
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:49:55 dist-test-slave-2p8l krb5kdc[30775](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:49:55 dist-test-slave-2p8l krb5kdc[30775](info): set up 2 sockets
Aug 07 19:49:55 dist-test-slave-2p8l krb5kdc[30775](info): commencing operation
krb5kdc: starting...
W20260807 19:49:57.190256 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.390s user 0.004s sys 0.051s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:49:57 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132197, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:49:57Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:49:57Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/rangeradmin_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/rangeradmin_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/rangerlookup_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/rangerlookup_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
I20260807 19:49:57.717866 12910 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskviQnk1/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/postgres -l logfile start
2026-08-07 19:50:00.540 UTC [30823] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 19:50:00.540 UTC [30823] LOG: listening on IPv4 address "127.12.155.148", port 32863
2026-08-07 19:50:00.544 UTC [30823] LOG: listening on Unix socket "/tmp/.s.PGSQL.32863"
2026-08-07 19:50:00.571 UTC [30826] LOG: database system was shut down at 2026-08-07 19:49:58 UTC
2026-08-07 19:50:00.575 UTC [30823] LOG: database system is ready to accept connections
I20260807 19:50:01.839417 12910 mini_postgres.cc:96] Postgres bound to 32863
2026-08-07 19:50:01.873 UTC [30849] FATAL: database "slave" does not exist
127.12.155.148:32863 - accepting connections
I20260807 19:50:01.874492 12910 mini_ranger.cc:161] Starting Ranger...
I20260807 19:50:01.917830 12910 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 19:50:02.490109 12910 mini_ranger.cc:87] Created ranger Postgres database
I20260807 19:50:02.490337 12910 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-admin
2026-08-07 19:50:02,856 [I] DB FLAVOR :POSTGRES
2026-08-07 19:50:02,856 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:50:02,856 [I] Checking connection..
2026-08-07 19:50:02,856 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 19:50:03,170 [I] Checking connection passed.
2026-08-07 19:50:03,170 [I] --------- Verifying version history table ---------
2026-08-07 19:50:03,170 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:50:03,466 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:50:03,466 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:50:03,763 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:50:03,763 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 19:50:03,763 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 19:50:04.049 UTC [30958] WARNING: there is no transaction in progress
2026-08-07 19:50:04,062 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 19:50:04,063 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:50:04,357 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 19:50:04,358 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:50:04,358 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 19:50:04,649 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 19:50:04,949 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2p8l.c.gcp-upstream.internal','N') ;"
2026-08-07 19:50:05,219 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:50:05,532 [I] Table x_portal_user does not exist in database ranger
2026-08-07 19:50:05,533 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:50:05,830 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 19:50:05,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:50:06,090 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:50:06,357 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 19:50:06,357 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 19:50:07.361 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.378 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.394 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.411 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.429 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.450 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.509 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.516 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.532 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.542 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.552 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.566 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.576 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.582 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.589 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:07.597 UTC [31124] WARNING: there is no transaction in progress
2026-08-07 19:50:08,301 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 19:50:08,301 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 19:50:08,569 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 19:50:08,569 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:50:08,838 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 19:50:08,838 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:50:09,123 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 19:50:09,123 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:50:09,386 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:50:09,659 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2p8l.c.gcp-upstream.internal';"
2026-08-07 19:50:09,904 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 19:50:09,905 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 19:50:10,170 [I] DB_PATCHES have already been applied
I20260807 19:50:10.176898 12910 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-admin:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskviQnk1/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 19:50:10.177002 12910 mini_ranger.cc:193] Using host: 127.12.155.148
I20260807 19:50:10.199136 12910 mini_ranger.cc:227] Ranger admin URL: http://127.12.155.148:37683
Aug 07, 2026 7:50:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:50:10 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:50:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 7:50:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 7:50:10 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 7:50:11 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 7:50:11 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 19:50:11.624686 12910 mini_ranger.cc:160] Time spent starting Ranger: real 9.750s user 0.008s sys 0.069s
Aug 07, 2026 7:50:32 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 7:50:32 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.UserREST
Aug 07, 2026 7:50:32 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 7:50:32 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 7:50:33 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 19:50:34.007164 12910 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/rangerkms_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/rangerkms_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.155.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.155.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 19:50:34 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132234, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 19:50:34.228849 12910 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 19:50:34.257136 12910 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 19:50:35.210497 12910 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 19:50:35.210692 12910 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms
I20260807 19:50:35.210840 12910 mini_ranger_kms.cc:227] Using postgres at 127.12.155.148:32863
2026-08-07 19:50:35,821 [I] DB FLAVOR :POSTGRES
2026-08-07 19:50:35,822 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:50:35,822 [I] Checking connection
2026-08-07 19:50:35,822 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 19:50:36,077 [I] connection success
2026-08-07 19:50:36,077 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 19:50:36,077 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 19:50:36,077 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 19:50:36,337 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 19:50:36,337 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:50:36,338 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 19:50:36,338 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:32863/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 19:50:36,614 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 19:50:37.109750 12910 mini_ranger_kms.cc:310] Created kms service
I20260807 19:50:37.311419 12910 mini_ranger_kms.cc:326] Created kudu user
I20260807 19:50:37.355430 12910 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 19:50:37 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132234, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:37.761816 12910 mini_ranger_kms.cc:384] Added ranger policy
I20260807 19:50:37.763185 12910 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms:/tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 19:50:37.763262 12910 mini_ranger_kms.cc:240] Using host: 127.12.155.148
I20260807 19:50:37.792428 12910 mini_ranger_kms.cc:276] Ranger KMS PID: 31416
I20260807 19:50:37.792640 12910 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.155.148:55109
Aug 07, 2026 7:50:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:50:38 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:50:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 7:50:38 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 7:50:39 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 7:50:39 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 19:50:40 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132240, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.155.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 19:50:40 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132240, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.155.148@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:40.889245 12910 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.660s user 0.119s sys 0.517s
I20260807 19:50:40.889731 12910 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 19:50:40.890020 12910 mini_ranger_kms.cc:401] 127.12.155.148:55109/kms/v1/keys
Aug 07 19:50:41 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132240, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.155.148@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
Aug 07 19:50:43 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:50:43.441761 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43739
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43739
--ranger_config_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:55109/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:50:43.907136 31495 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:50:43.907573 31495 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:50:43.907799 31495 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:50:43.916456 31495 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:50:43.916587 31495 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:50:43.916723 31495 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:50:43.916816 31495 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:50:43.916898 31495 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:50:43.927966 31495 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.155.148:55109/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43739
--ranger_config_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43739
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:50:43.929370 31495 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:50:43.930846 31495 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:50:43.944730 31504 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:43.944793 31508 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:43.944867 31506 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:50:43.945953 31495 server_base.cc:1034] running on GCE node
I20260807 19:50:43.946762 31495 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:50:43.948132 31495 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:50:43.949342 31495 hybrid_clock.cc:648] HybridClock initialized: now 1786132243949300 us; error 36 us; skew 500 ppm
I20260807 19:50:43.949666 31495 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:50:43 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:50:43.957000 31495 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:50:43.959260 31495 webserver.cc:460] Webserver started at http://127.12.155.190:45617/ using document root <none> and password file <none>
I20260807 19:50:43.960081 31495 fs_manager.cc:359] Metadata directory not provided
I20260807 19:50:43.960340 31495 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:50:43.960749 31495 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:50:43 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:44.013993 31495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "5f6fa905277c44f98ca58d055587fdcc"
format_stamp: "Formatted at 2026-08-07 19:50:44 on dist-test-slave-2p8l"
server_key: "645062aa1f762559d2cee7cb783fcf81"
server_key_iv: "da85cf0dd45f54c4f5f4c6556b77b932"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:44.015079 31495 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "5f6fa905277c44f98ca58d055587fdcc"
format_stamp: "Formatted at 2026-08-07 19:50:44 on dist-test-slave-2p8l"
server_key: "645062aa1f762559d2cee7cb783fcf81"
server_key_iv: "da85cf0dd45f54c4f5f4c6556b77b932"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:44.021027 31495 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.001s sys 0.004s
I20260807 19:50:44.038344 31518 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:44.040009 31495 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:50:44.040289 31495 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "5f6fa905277c44f98ca58d055587fdcc"
format_stamp: "Formatted at 2026-08-07 19:50:44 on dist-test-slave-2p8l"
server_key: "645062aa1f762559d2cee7cb783fcf81"
server_key_iv: "da85cf0dd45f54c4f5f4c6556b77b932"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:44.040607 31495 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:50:44.067893 31495 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:50:44.072510 31495 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:50:44.072867 31495 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:50:44.102358 31495 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43739
I20260807 19:50:44.102384 31597 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43739 every 8 connection(s)
I20260807 19:50:44.103813 31495 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:50:44.108263 31598 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:50:44.111008 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 31495
I20260807 19:50:44.111245 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:50:44.112141 12910 external_mini_cluster.cc:1428] Setting key 4e7a4880355c0f73f8e4cde15215e5ab
I20260807 19:50:44.124312 31598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc: Bootstrap starting.
I20260807 19:50:44.129277 31598 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc: Neither blocks nor log segments found. Creating new log.
Aug 07 19:50:44 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:50:44.131774 31598 log.cc:824] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc: Log is configured to *not* fsync() on all Append() calls
I20260807 19:50:44.136574 31598 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc: No bootstrap required, opened a new log
I20260807 19:50:44.141274 31604 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:44.114876 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41888 (local address 127.12.155.190:43739)
0807 19:50:44.116417 (+ 1541us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:44.116430 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:44.116541 (+ 111us) server_negotiation.cc:407] Connection header received
0807 19:50:44.118947 (+ 2406us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:44.118973 (+ 26us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:44.119349 (+ 376us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:44.119678 (+ 329us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:44.121663 (+ 1985us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:44.123204 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:44.125264 (+ 2060us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:44.125936 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:44.126184 (+ 248us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:44.132078 (+ 5894us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:44.132088 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:44.132104 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:44.132145 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:44.136480 (+ 4335us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:44.137579 (+ 1099us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:44.137591 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:44.137602 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:44.137853 (+ 251us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:44.138368 (+ 515us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:44.138373 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:44.138376 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:44.138950 (+ 574us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:44.139170 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:44.139818 (+ 648us) server_negotiation.cc:299] Negotiation successful
0807 19:50:44.140116 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1284,"thread_start_us":968,"threads_started":1}
I20260807 19:50:44.147621 31598 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f6fa905277c44f98ca58d055587fdcc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43739 } }
I20260807 19:50:44.148016 31598 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:50:44.148139 31598 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5f6fa905277c44f98ca58d055587fdcc, State: Initialized, Role: FOLLOWER
I20260807 19:50:44.148856 31598 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f6fa905277c44f98ca58d055587fdcc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43739 } }
I20260807 19:50:44.149173 31598 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:50:44.149344 31598 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:50:44.149551 31598 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:50:44.151870 31598 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f6fa905277c44f98ca58d055587fdcc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43739 } }
I20260807 19:50:44.152391 31598 leader_election.cc:302] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5f6fa905277c44f98ca58d055587fdcc; no voters:
I20260807 19:50:44.153049 31598 leader_election.cc:288] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:50:44.153249 31606 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:50:44.155241 31606 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [term 1 LEADER]: Becoming Leader. State: Replica: 5f6fa905277c44f98ca58d055587fdcc, State: Running, Role: LEADER
I20260807 19:50:44.155793 31598 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:50:44.156131 31606 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f6fa905277c44f98ca58d055587fdcc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43739 } }
I20260807 19:50:44.164142 31607 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5f6fa905277c44f98ca58d055587fdcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f6fa905277c44f98ca58d055587fdcc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43739 } } }
I20260807 19:50:44.164772 31607 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [sys.catalog]: This master's current role is: LEADER
I20260807 19:50:44.165841 31610 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5f6fa905277c44f98ca58d055587fdcc. Latest consensus state: current_term: 1 leader_uuid: "5f6fa905277c44f98ca58d055587fdcc" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5f6fa905277c44f98ca58d055587fdcc" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43739 } } }
I20260807 19:50:44.166286 31610 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc [sys.catalog]: This master's current role is: LEADER
I20260807 19:50:44.166653 31623 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:50:44.173223 31623 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:50:44.174424 31598 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 19:50:44.192862 31623 catalog_manager.cc:1347] Generated new cluster ID: cb8ea13265ab4dcbbdd715753a3eca7e
I20260807 19:50:44.193014 31623 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:50:44.225597 31623 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:50:44.227869 31623 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:50:44.245357 31623 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc: Generated new TSK 0
I20260807 19:50:44.246620 31623 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:50:45.100108 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:55109/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43739
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:50:45 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132245, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 19:50:45.597649 31659 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:50:45.598140 31659 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:50:45.598377 31659 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:50:45.611670 31659 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:50:45.611833 31659 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:50:45.612037 31659 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:50:45.629974 31659 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.155.148:55109/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:50:45.632184 31659 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:50:45.634403 31659 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:50:45.656610 31675 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:45.657095 31676 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:45.662144 31683 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:50:45.664089 31659 server_base.cc:1034] running on GCE node
I20260807 19:50:45.664981 31659 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:50:45.666392 31659 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:50:45.667651 31659 hybrid_clock.cc:648] HybridClock initialized: now 1786132245667585 us; error 66 us; skew 500 ppm
I20260807 19:50:45.668031 31659 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:50:45 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132245, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:50:45.672055 31659 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:50:45.676189 31659 webserver.cc:460] Webserver started at http://127.12.155.129:38891/ using document root <none> and password file <none>
I20260807 19:50:45.677172 31659 fs_manager.cc:359] Metadata directory not provided
I20260807 19:50:45.677304 31659 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:50:45.677736 31659 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:50:45 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132245, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:45.697717 31659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "063decd7f41b4c479caa59d951597840"
format_stamp: "Formatted at 2026-08-07 19:50:45 on dist-test-slave-2p8l"
server_key: "c7ae2079f1e4d9b72cd2667bf58bf60f"
server_key_iv: "5957e460754bb4655afd9a48146e1344"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:45.699244 31659 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "063decd7f41b4c479caa59d951597840"
format_stamp: "Formatted at 2026-08-07 19:50:45 on dist-test-slave-2p8l"
server_key: "c7ae2079f1e4d9b72cd2667bf58bf60f"
server_key_iv: "5957e460754bb4655afd9a48146e1344"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:45.707198 31659 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.007s sys 0.001s
I20260807 19:50:45.748997 31697 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:45.750835 31659 fs_manager.cc:725] Time spent opening block manager: real 0.010s user 0.004s sys 0.004s
I20260807 19:50:45.751056 31659 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "063decd7f41b4c479caa59d951597840"
format_stamp: "Formatted at 2026-08-07 19:50:45 on dist-test-slave-2p8l"
server_key: "c7ae2079f1e4d9b72cd2667bf58bf60f"
server_key_iv: "5957e460754bb4655afd9a48146e1344"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:45.751333 31659 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:50:45.834301 31659 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:50:45.839754 31659 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:50:45.840121 31659 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:50:45.847438 31659 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:50:45.855581 31659 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:50:45.855692 31659 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:45.855834 31659 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:50:45.855899 31659 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:50:45 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132245, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:46.165768 31659 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:37573
I20260807 19:50:46.165899 31883 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:37573 every 8 connection(s)
I20260807 19:50:46.167258 31659 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:50:46.175726 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 31659
I20260807 19:50:46.176064 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:50:46.177353 12910 external_mini_cluster.cc:1428] Setting key ed840a53dbcef39d06f84c51dfa1dc25
Aug 07 19:50:46 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132245, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:50:46.224929 31886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:46.170721 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:35835 (local address 127.12.155.190:43739)
0807 19:50:46.187065 (+ 16344us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:46.187074 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:46.189255 (+ 2181us) server_negotiation.cc:407] Connection header received
0807 19:50:46.193014 (+ 3759us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:46.193020 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:46.193120 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:46.193216 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:46.196156 (+ 2940us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.197485 (+ 1329us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.208549 (+ 11064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.209541 (+ 992us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.209660 (+ 119us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:46.216322 (+ 6662us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:46.216331 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:46.216336 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:46.216396 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:46.220451 (+ 4055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:46.221541 (+ 1090us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:46.221548 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:46.221551 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:46.221731 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:46.222419 (+ 688us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:46.222425 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:46.222429 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:46.222857 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:46.223032 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:46.224200 (+ 1168us) server_negotiation.cc:299] Negotiation successful
0807 19:50:46.224492 (+ 292us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16137,"thread_start_us":18536,"threads_started":1}
I20260807 19:50:46.227862 31887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:46.171612 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43739 (local address 127.12.155.129:35835)
0807 19:50:46.187803 (+ 16191us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:46.187883 (+ 80us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:46.192605 (+ 4722us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:46.193879 (+ 1274us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:46.193896 (+ 17us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:46.194753 (+ 857us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:50:46.195877 (+ 1124us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:46.195913 (+ 36us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.197736 (+ 1823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.197742 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:46.208257 (+ 10515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:46.208318 (+ 61us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.210624 (+ 2306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.210640 (+ 16us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:46.211109 (+ 469us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:46.212237 (+ 1128us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:50:46.212293 (+ 56us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:50:46.215989 (+ 3696us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:50:46.220649 (+ 4660us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:50:46.220659 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:50:46.220679 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:50:46.221376 (+ 697us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:50:46.221923 (+ 547us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:50:46.221928 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:50:46.221932 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:50:46.222261 (+ 329us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:50:46.223150 (+ 889us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:50:46.223158 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:50:46.223672 (+ 514us) client_negotiation.cc:769] Sending connection context
0807 19:50:46.225594 (+ 1922us) client_negotiation.cc:240] Negotiation successful
0807 19:50:46.226245 (+ 651us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15813,"thread_start_us":15539,"threads_started":1}
I20260807 19:50:46.230367 31884 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43739
I20260807 19:50:46.230729 31884 heartbeater.cc:464] Registering TS with master...
I20260807 19:50:46.231711 31884 heartbeater.cc:511] Master 127.12.155.190:43739 requested a full tablet report, sending...
I20260807 19:50:46.234611 31546 ts_manager.cc:194] Registered new tserver with Master: 063decd7f41b4c479caa59d951597840 (127.12.155.129:37573)
I20260807 19:50:46.237082 31546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:35835
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:50:46.288066 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:55109/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43739
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:50:46 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132245, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
W20260807 19:50:46.781349 31890 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:50:46.781677 31890 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:50:46.781913 31890 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:50:46.789981 31890 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:50:46.790153 31890 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:50:46.790361 31890 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:50:46.801124 31890 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.155.148:55109/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:50:46.802809 31890 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:50:46.804113 31890 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:50:46.819703 31917 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:46.819777 31914 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:46.819790 31915 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:50:46.823642 31890 server_base.cc:1034] running on GCE node
I20260807 19:50:46.824254 31890 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:50:46.825268 31890 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:50:46.826553 31890 hybrid_clock.cc:648] HybridClock initialized: now 1786132246826500 us; error 55 us; skew 500 ppm
I20260807 19:50:46.826942 31890 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:50:46 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132246, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:50:46.830478 31890 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:50:46.832181 31890 webserver.cc:460] Webserver started at http://127.12.155.130:44565/ using document root <none> and password file <none>
I20260807 19:50:46.832988 31890 fs_manager.cc:359] Metadata directory not provided
I20260807 19:50:46.833145 31890 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:50:46.833491 31890 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:50:46 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132246, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:46.851679 31890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "3e90b00be5aa495f8b578afcb65ccb85"
format_stamp: "Formatted at 2026-08-07 19:50:46 on dist-test-slave-2p8l"
server_key: "b827499704387f4fbd169fc5773afb8a"
server_key_iv: "7645133a95f2cdab9bc4df2dc5268806"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:46.852738 31890 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "3e90b00be5aa495f8b578afcb65ccb85"
format_stamp: "Formatted at 2026-08-07 19:50:46 on dist-test-slave-2p8l"
server_key: "b827499704387f4fbd169fc5773afb8a"
server_key_iv: "7645133a95f2cdab9bc4df2dc5268806"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:46.860101 31890 fs_manager.cc:691] Time spent creating directory manager: real 0.007s user 0.008s sys 0.000s
I20260807 19:50:46.878551 31933 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:46.880273 31890 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:50:46.880446 31890 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "3e90b00be5aa495f8b578afcb65ccb85"
format_stamp: "Formatted at 2026-08-07 19:50:46 on dist-test-slave-2p8l"
server_key: "b827499704387f4fbd169fc5773afb8a"
server_key_iv: "7645133a95f2cdab9bc4df2dc5268806"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:46.880694 31890 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:50:46.907023 31890 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:50:46.913467 31890 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:50:46.913823 31890 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:50:46.915084 31890 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:50:46.916880 31890 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:50:46.916978 31890 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:46.917121 31890 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:50:46.917230 31890 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:46.969498 31890 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:35189
I20260807 19:50:46.969512 32113 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:35189 every 8 connection(s)
I20260807 19:50:46.971241 31890 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:50:46.979935 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 31890
I20260807 19:50:46.980129 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:50:46.980605 12910 external_mini_cluster.cc:1428] Setting key 920d63bd2e125565973cb5ef5d10d1a0
Aug 07 19:50:46 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132246, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:50:46.995978 32120 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:46.975090 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43739 (local address 127.12.155.130:35345)
0807 19:50:46.976370 (+ 1280us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:46.976422 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:46.979111 (+ 2689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:46.979940 (+ 829us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:46.979952 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:46.980619 (+ 667us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:50:46.981460 (+ 841us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:46.981497 (+ 37us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.983077 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.983081 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:46.984705 (+ 1624us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:46.984726 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.985507 (+ 781us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.985515 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:46.985862 (+ 347us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:46.986649 (+ 787us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:50:46.986673 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:50:46.988769 (+ 2096us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:50:46.991944 (+ 3175us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:50:46.991953 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:50:46.991970 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:50:46.992433 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:50:46.992829 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:50:46.992834 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:50:46.992838 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:50:46.993047 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:50:46.993601 (+ 554us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:50:46.993609 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:50:46.993946 (+ 337us) client_negotiation.cc:769] Sending connection context
0807 19:50:46.994282 (+ 336us) client_negotiation.cc:240] Negotiation successful
0807 19:50:46.994880 (+ 598us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"thread_start_us":611,"threads_started":1}
I20260807 19:50:46.997025 32119 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:46.974393 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:35345 (local address 127.12.155.190:43739)
0807 19:50:46.974913 (+ 520us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:46.974920 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:46.976563 (+ 1643us) server_negotiation.cc:407] Connection header received
0807 19:50:46.979430 (+ 2867us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:46.979434 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:46.979543 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:46.979673 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:46.981654 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.982851 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.984871 (+ 2020us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:46.985271 (+ 400us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:46.985510 (+ 239us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:46.988993 (+ 3483us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:46.988998 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:46.989001 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:46.989042 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:46.991787 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:46.992559 (+ 772us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:46.992567 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:46.992574 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:46.992697 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:46.993164 (+ 467us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:46.993170 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:46.993173 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:46.993453 (+ 280us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:46.993606 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:46.996570 (+ 2964us) server_negotiation.cc:299] Negotiation successful
0807 19:50:46.996777 (+ 207us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":376,"thread_start_us":254,"threads_started":1}
I20260807 19:50:46.998358 32115 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43739
I20260807 19:50:46.998728 32115 heartbeater.cc:464] Registering TS with master...
I20260807 19:50:46.999640 32115 heartbeater.cc:511] Master 127.12.155.190:43739 requested a full tablet report, sending...
I20260807 19:50:47.001473 31546 ts_manager.cc:194] Registered new tserver with Master: 3e90b00be5aa495f8b578afcb65ccb85 (127.12.155.130:35189)
I20260807 19:50:47.002898 31546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:35345
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:50:47.050293 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:55109/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43739
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33125
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:50:47.241792 31884 heartbeater.cc:503] Master 127.12.155.190:43739 was elected leader, sending a full tablet report...
W20260807 19:50:47.513759 32123 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:50:47.514094 32123 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:50:47.514315 32123 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:50:47.523061 32123 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:50:47.523226 32123 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:50:47.523363 32123 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:50:47.535368 32123 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33125
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.155.148:55109/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43739
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:50:47.536908 32123 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:50:47.538357 32123 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:50:47.554610 32128 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:47.554415 32129 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:50:47.555403 32132 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:50:47.556948 32123 server_base.cc:1034] running on GCE node
I20260807 19:50:47.557631 32123 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:50:47.558804 32123 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:50:47.560151 32123 hybrid_clock.cc:648] HybridClock initialized: now 1786132247560007 us; error 47 us; skew 500 ppm
I20260807 19:50:47.560719 32123 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:50:47 dist-test-slave-2p8l krb5kdc[30775](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132247, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:50:47.565184 32123 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:50:47.567046 32123 webserver.cc:460] Webserver started at http://127.12.155.131:39585/ using document root <none> and password file <none>
I20260807 19:50:47.568132 32123 fs_manager.cc:359] Metadata directory not provided
I20260807 19:50:47.568385 32123 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:50:47.568774 32123 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:50:47 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132247, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:50:47.586156 32123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "de8f213706a24134a0f7c6ec50cb9007"
format_stamp: "Formatted at 2026-08-07 19:50:47 on dist-test-slave-2p8l"
server_key: "6df813a03ed7a855af0cc793fbec3b76"
server_key_iv: "5312e25c15dbccef005a5f390641fedd"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:47.587229 32123 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "de8f213706a24134a0f7c6ec50cb9007"
format_stamp: "Formatted at 2026-08-07 19:50:47 on dist-test-slave-2p8l"
server_key: "6df813a03ed7a855af0cc793fbec3b76"
server_key_iv: "5312e25c15dbccef005a5f390641fedd"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:47.594162 32123 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.001s
I20260807 19:50:47.613651 32142 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:47.615525 32123 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:50:47.615756 32123 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "de8f213706a24134a0f7c6ec50cb9007"
format_stamp: "Formatted at 2026-08-07 19:50:47 on dist-test-slave-2p8l"
server_key: "6df813a03ed7a855af0cc793fbec3b76"
server_key_iv: "5312e25c15dbccef005a5f390641fedd"
server_key_version: "kuduclusterkey@0"
I20260807 19:50:47.616094 32123 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:50:47.631592 32123 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:50:47.637293 32123 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:50:47.637864 32123 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:50:47.639509 32123 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:50:47.641777 32123 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:50:47.641942 32123 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:50:47.642187 32123 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:50:47.642310 32123 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260807 19:50:47.715975 32123 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:39891
I20260807 19:50:47.716217 32327 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:39891 every 8 connection(s)
I20260807 19:50:47.717402 32123 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:50:47.726559 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 32123
I20260807 19:50:47.726748 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:50:47.727298 12910 external_mini_cluster.cc:1428] Setting key 47d2398a14fd827f8526edb9d1c6115c
Aug 07 19:50:47 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132247, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:50:47.745265 32331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.721345 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:38179 (local address 127.12.155.190:43739)
0807 19:50:47.722558 (+ 1213us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:47.722566 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:47.723264 (+ 698us) server_negotiation.cc:407] Connection header received
0807 19:50:47.725941 (+ 2677us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:47.725946 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:47.726048 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:47.726214 (+ 166us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:47.728306 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.729594 (+ 1288us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.731865 (+ 2271us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.732447 (+ 582us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.732561 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.737127 (+ 4566us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:47.737133 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:47.737137 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:47.737182 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:47.740760 (+ 3578us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:47.741746 (+ 986us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:47.741750 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:47.741753 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:47.741944 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:47.742823 (+ 879us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:47.742834 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:47.742837 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:47.743366 (+ 529us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:47.743671 (+ 305us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:47.744391 (+ 720us) server_negotiation.cc:299] Negotiation successful
0807 19:50:47.744676 (+ 285us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1037,"thread_start_us":771,"threads_started":1}
I20260807 19:50:47.746577 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.721978 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43739 (local address 127.12.155.131:38179)
0807 19:50:47.723104 (+ 1126us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:47.723142 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:47.725671 (+ 2529us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:47.726455 (+ 784us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:47.726463 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:47.727142 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:50:47.728092 (+ 950us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.728120 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.729829 (+ 1709us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.729833 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.731658 (+ 1825us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.731698 (+ 40us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.732745 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.732751 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.733075 (+ 324us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.734011 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:50:47.734034 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:50:47.736797 (+ 2763us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:50:47.740905 (+ 4108us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:50:47.740913 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:50:47.740926 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:50:47.741610 (+ 684us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:50:47.742147 (+ 537us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:50:47.742159 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:50:47.742162 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:50:47.742667 (+ 505us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:50:47.743516 (+ 849us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:50:47.743525 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:50:47.743961 (+ 436us) client_negotiation.cc:769] Sending connection context
0807 19:50:47.744297 (+ 336us) client_negotiation.cc:240] Negotiation successful
0807 19:50:47.744960 (+ 663us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":869,"thread_start_us":562,"threads_started":1}
I20260807 19:50:47.748451 32328 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43739
I20260807 19:50:47.748864 32328 heartbeater.cc:464] Registering TS with master...
I20260807 19:50:47.749917 32328 heartbeater.cc:511] Master 127.12.155.190:43739 requested a full tablet report, sending...
I20260807 19:50:47.751909 31546 ts_manager.cc:194] Registered new tserver with Master: de8f213706a24134a0f7c6ec50cb9007 (127.12.155.131:39891)
I20260807 19:50:47.752915 31546 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:38179
I20260807 19:50:47.756597 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:50:47.780090 32331 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.763141 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44656 (local address 127.12.155.190:43739)
0807 19:50:47.763316 (+ 175us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:47.763321 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:47.764150 (+ 829us) server_negotiation.cc:407] Connection header received
0807 19:50:47.764337 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:47.764342 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:47.764473 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:47.764566 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:47.766439 (+ 1873us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.767566 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.769381 (+ 1815us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.770158 (+ 777us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.770272 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.773672 (+ 3400us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:47.773677 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:47.773680 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:47.773715 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:47.777048 (+ 3333us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:47.777935 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:47.777939 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:47.777942 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:47.778212 (+ 270us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:47.778685 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:47.778699 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:47.778701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:47.779043 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:47.779292 (+ 249us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:47.779611 (+ 319us) server_negotiation.cc:299] Negotiation successful
0807 19:50:47.779786 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:50:47.785620 31546 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44656:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:50:47.796254 31546 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:50:47.847738 32356 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.831114 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:39891 (local address 127.0.0.1:40528)
0807 19:50:47.833802 (+ 2688us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:47.833824 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:47.834003 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:47.835868 (+ 1865us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:47.835875 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:47.835904 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:50:47.837202 (+ 1298us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.837227 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.840599 (+ 3372us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.840605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.843771 (+ 3166us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.843784 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.846334 (+ 2550us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.846353 (+ 19us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.846636 (+ 283us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.846726 (+ 90us) client_negotiation.cc:769] Sending connection context
0807 19:50:47.846893 (+ 167us) client_negotiation.cc:240] Negotiation successful
0807 19:50:47.847089 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2569,"mutex_wait_us":54,"thread_start_us":2973,"threads_started":1}
I20260807 19:50:47.849323 32353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.830038 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40528 (local address 127.12.155.131:39891)
0807 19:50:47.831099 (+ 1061us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:47.831108 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:47.833933 (+ 2825us) server_negotiation.cc:407] Connection header received
0807 19:50:47.834420 (+ 487us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:47.834438 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:47.834812 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:47.835113 (+ 301us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:50:47.837702 (+ 2589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.840326 (+ 2624us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.843927 (+ 3601us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.845803 (+ 1876us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.848298 (+ 2495us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.848495 (+ 197us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:47.848627 (+ 132us) server_negotiation.cc:299] Negotiation successful
0807 19:50:47.848819 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":876,"thread_start_us":605,"threads_started":1}
I20260807 19:50:47.849663 32351 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.814535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:35189 (local address 127.0.0.1:44194)
0807 19:50:47.832282 (+ 17747us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:47.832322 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:47.832473 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:47.836779 (+ 4306us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:47.836783 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:47.836806 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:50:47.838290 (+ 1484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.838309 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.841152 (+ 2843us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.841157 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.845108 (+ 3951us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.845125 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.848392 (+ 3267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.848401 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.848655 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.848688 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:50:47.848770 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 19:50:47.848898 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17581,"mutex_wait_us":121,"spinlock_wait_cycles":8576,"thread_start_us":17274,"threads_started":1}
I20260807 19:50:47.849856 32349 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.814006 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37573 (local address 127.0.0.1:55484)
0807 19:50:47.827722 (+ 13716us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:47.827796 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:47.828095 (+ 299us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:47.836528 (+ 8433us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:47.836533 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:47.836559 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:50:47.838941 (+ 2382us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.838953 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.841540 (+ 2587us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.841548 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.845169 (+ 3621us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:47.845183 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.848331 (+ 3148us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.848345 (+ 14us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:47.848590 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.848627 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:50:47.848718 (+ 91us) client_negotiation.cc:240] Negotiation successful
0807 19:50:47.848879 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13237,"mutex_wait_us":59,"thread_start_us":14342,"threads_started":1}
I20260807 19:50:47.850220 32352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.814767 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55484 (local address 127.12.155.129:37573)
0807 19:50:47.835988 (+ 21221us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:47.835995 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:47.836022 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:50:47.836109 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:47.836115 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:47.836277 (+ 162us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:47.836474 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:50:47.839364 (+ 2890us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.841378 (+ 2014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.845389 (+ 4011us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.847476 (+ 2087us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.848196 (+ 720us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.848402 (+ 206us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:47.848780 (+ 378us) server_negotiation.cc:299] Negotiation successful
0807 19:50:47.849024 (+ 244us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":21023,"thread_start_us":20730,"threads_started":1}
I20260807 19:50:47.851219 32350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:47.814388 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44194 (local address 127.12.155.130:35189)
0807 19:50:47.835092 (+ 20704us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:47.835101 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:47.835128 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:50:47.835247 (+ 119us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:47.835255 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:47.835645 (+ 390us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:47.836799 (+ 1154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:50:47.838610 (+ 1811us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.840956 (+ 2346us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.845313 (+ 4357us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:47.847480 (+ 2167us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:47.847720 (+ 240us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:47.847930 (+ 210us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:47.850033 (+ 2103us) server_negotiation.cc:299] Negotiation successful
0807 19:50:47.850691 (+ 658us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":20473,"thread_start_us":20244,"threads_started":1}
I20260807 19:50:47.854904 31780 tablet_service.cc:1467] Processing CreateTablet for tablet 1fbab5e1b9b4433cba6fad9d099eda14 (DEFAULT_TABLE table=test-table [id=275e63152d7642fbb9cf26fcb441fd3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:50:47.854877 32219 tablet_service.cc:1467] Processing CreateTablet for tablet 1fbab5e1b9b4433cba6fad9d099eda14 (DEFAULT_TABLE table=test-table [id=275e63152d7642fbb9cf26fcb441fd3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:50:47.854792 32012 tablet_service.cc:1467] Processing CreateTablet for tablet 1fbab5e1b9b4433cba6fad9d099eda14 (DEFAULT_TABLE table=test-table [id=275e63152d7642fbb9cf26fcb441fd3c]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:50:47.856752 32012 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fbab5e1b9b4433cba6fad9d099eda14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:50:47.856844 31780 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fbab5e1b9b4433cba6fad9d099eda14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:50:47.856976 32219 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1fbab5e1b9b4433cba6fad9d099eda14. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:50:47.873234 32358 tablet_bootstrap.cc:492] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Bootstrap starting.
I20260807 19:50:47.877947 32359 tablet_bootstrap.cc:492] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Bootstrap starting.
I20260807 19:50:47.880548 32358 tablet_bootstrap.cc:654] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Neither blocks nor log segments found. Creating new log.
I20260807 19:50:47.883147 32358 log.cc:824] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Log is configured to *not* fsync() on all Append() calls
I20260807 19:50:47.883931 32360 tablet_bootstrap.cc:492] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Bootstrap starting.
I20260807 19:50:47.884377 32359 tablet_bootstrap.cc:654] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Neither blocks nor log segments found. Creating new log.
I20260807 19:50:47.886881 32359 log.cc:824] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Log is configured to *not* fsync() on all Append() calls
I20260807 19:50:47.889194 32358 tablet_bootstrap.cc:492] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: No bootstrap required, opened a new log
I20260807 19:50:47.889634 32358 ts_tablet_manager.cc:1397] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Time spent bootstrapping tablet: real 0.017s user 0.011s sys 0.000s
I20260807 19:50:47.890520 32360 tablet_bootstrap.cc:654] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Neither blocks nor log segments found. Creating new log.
I20260807 19:50:47.891837 32359 tablet_bootstrap.cc:492] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: No bootstrap required, opened a new log
I20260807 19:50:47.892266 32359 ts_tablet_manager.cc:1397] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Time spent bootstrapping tablet: real 0.015s user 0.004s sys 0.008s
I20260807 19:50:47.892463 32360 log.cc:824] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Log is configured to *not* fsync() on all Append() calls
I20260807 19:50:47.896735 32360 tablet_bootstrap.cc:492] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: No bootstrap required, opened a new log
I20260807 19:50:47.897119 32360 ts_tablet_manager.cc:1397] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Time spent bootstrapping tablet: real 0.013s user 0.011s sys 0.000s
I20260807 19:50:47.907941 32360 raft_consensus.cc:348] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:47.907881 32358 raft_consensus.cc:348] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:47.908463 32360 raft_consensus.cc:374] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:50:47.908591 32358 raft_consensus.cc:374] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:50:47.908674 32360 raft_consensus.cc:729] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: de8f213706a24134a0f7c6ec50cb9007, State: Initialized, Role: FOLLOWER
I20260807 19:50:47.908793 32358 raft_consensus.cc:729] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e90b00be5aa495f8b578afcb65ccb85, State: Initialized, Role: FOLLOWER
I20260807 19:50:47.909694 32360 consensus_queue.cc:260] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:47.909585 32358 consensus_queue.cc:260] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:47.909945 32359 raft_consensus.cc:348] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:47.910651 32359 raft_consensus.cc:374] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:50:47.910858 32359 raft_consensus.cc:729] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 063decd7f41b4c479caa59d951597840, State: Initialized, Role: FOLLOWER
I20260807 19:50:47.911867 32328 heartbeater.cc:503] Master 127.12.155.190:43739 was elected leader, sending a full tablet report...
I20260807 19:50:47.911756 32359 consensus_queue.cc:260] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:47.913761 32115 heartbeater.cc:503] Master 127.12.155.190:43739 was elected leader, sending a full tablet report...
I20260807 19:50:47.913892 32358 ts_tablet_manager.cc:1428] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Time spent starting tablet: real 0.024s user 0.011s sys 0.014s
I20260807 19:50:47.914707 32359 ts_tablet_manager.cc:1428] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Time spent starting tablet: real 0.022s user 0.019s sys 0.005s
I20260807 19:50:47.915608 32360 ts_tablet_manager.cc:1428] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Time spent starting tablet: real 0.018s user 0.011s sys 0.005s
W20260807 19:50:47.958511 31885 tablet.cc:2369] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:50:47.970619 32330 tablet.cc:2369] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:50:47.974478 32118 tablet.cc:2369] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:50:48.032275 32369 raft_consensus.cc:482] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:50:48.032719 32369 raft_consensus.cc:504] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:48.035202 32369 leader_election.cc:288] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 3e90b00be5aa495f8b578afcb65ccb85 (127.12.155.130:35189), 063decd7f41b4c479caa59d951597840 (127.12.155.129:37573)
I20260807 19:50:48.043627 32350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.035698 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:53855 (local address 127.12.155.130:35189)
0807 19:50:48.036039 (+ 341us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:48.036045 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:48.036484 (+ 439us) server_negotiation.cc:407] Connection header received
0807 19:50:48.036756 (+ 272us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:48.036761 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:48.036859 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:48.036964 (+ 105us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:50:48.037600 (+ 636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.038857 (+ 1257us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.041202 (+ 2345us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.042399 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.042574 (+ 175us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.042650 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:48.043083 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 19:50:48.043206 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:50:48.043627 32332 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.036202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:35189 (local address 127.12.155.131:53855)
0807 19:50:48.036376 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:48.036392 (+ 16us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:48.036597 (+ 205us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:48.036990 (+ 393us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:48.036994 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:48.037021 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:50:48.037442 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:48.037451 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.039002 (+ 1551us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.039007 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:48.040964 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:48.040977 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.042604 (+ 1627us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.042610 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:48.042898 (+ 288us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.042927 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:50:48.043040 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 19:50:48.043178 (+ 138us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 19:50:48.045192 32038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fbab5e1b9b4433cba6fad9d099eda14" candidate_uuid: "de8f213706a24134a0f7c6ec50cb9007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e90b00be5aa495f8b578afcb65ccb85" is_pre_election: true
I20260807 19:50:48.046120 32038 raft_consensus.cc:2454] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de8f213706a24134a0f7c6ec50cb9007 in term 0.
I20260807 19:50:48.047225 32146 leader_election.cc:302] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e90b00be5aa495f8b578afcb65ccb85, de8f213706a24134a0f7c6ec50cb9007; no voters:
I20260807 19:50:48.047703 32352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.035757 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:58871 (local address 127.12.155.129:37573)
0807 19:50:48.036037 (+ 280us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:48.036045 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:48.038373 (+ 2328us) server_negotiation.cc:407] Connection header received
0807 19:50:48.038657 (+ 284us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:48.038663 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:48.038782 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:48.038893 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:50:48.040346 (+ 1453us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.041428 (+ 1082us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.044765 (+ 3337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.046241 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.046441 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.046493 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:48.047129 (+ 636us) server_negotiation.cc:299] Negotiation successful
0807 19:50:48.047310 (+ 181us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":89}
I20260807 19:50:48.048182 32374 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.036260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37573 (local address 127.12.155.131:58871)
0807 19:50:48.038264 (+ 2004us) negotiation.cc:107] Waiting for socket to connect
0807 19:50:48.038285 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:50:48.038488 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:50:48.038922 (+ 434us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:50:48.038927 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:50:48.038953 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:50:48.040113 (+ 1160us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:48.040126 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.041662 (+ 1536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.041667 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:48.044442 (+ 2775us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:50:48.044488 (+ 46us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.046650 (+ 2162us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.046662 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:50:48.046885 (+ 223us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.046949 (+ 64us) client_negotiation.cc:769] Sending connection context
0807 19:50:48.047050 (+ 101us) client_negotiation.cc:240] Negotiation successful
0807 19:50:48.047144 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1841,"mutex_wait_us":40,"thread_start_us":1415,"threads_started":1}
I20260807 19:50:48.048141 32369 raft_consensus.cc:2781] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:50:48.048463 32369 raft_consensus.cc:482] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:50:48.048691 32369 raft_consensus.cc:3037] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:50:48.050011 31807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fbab5e1b9b4433cba6fad9d099eda14" candidate_uuid: "de8f213706a24134a0f7c6ec50cb9007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063decd7f41b4c479caa59d951597840" is_pre_election: true
I20260807 19:50:48.051110 31807 raft_consensus.cc:2454] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate de8f213706a24134a0f7c6ec50cb9007 in term 0.
I20260807 19:50:48.053772 32369 raft_consensus.cc:504] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:48.054940 32369 leader_election.cc:288] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [CANDIDATE]: Term 1 election: Requested vote from peers 3e90b00be5aa495f8b578afcb65ccb85 (127.12.155.130:35189), 063decd7f41b4c479caa59d951597840 (127.12.155.129:37573)
I20260807 19:50:48.055672 31807 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fbab5e1b9b4433cba6fad9d099eda14" candidate_uuid: "de8f213706a24134a0f7c6ec50cb9007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "063decd7f41b4c479caa59d951597840"
I20260807 19:50:48.055658 32038 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fbab5e1b9b4433cba6fad9d099eda14" candidate_uuid: "de8f213706a24134a0f7c6ec50cb9007" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "3e90b00be5aa495f8b578afcb65ccb85"
I20260807 19:50:48.056007 31807 raft_consensus.cc:3037] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:50:48.056077 32038 raft_consensus.cc:3037] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:50:48.059796 32038 raft_consensus.cc:2454] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de8f213706a24134a0f7c6ec50cb9007 in term 1.
I20260807 19:50:48.059876 31807 raft_consensus.cc:2454] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate de8f213706a24134a0f7c6ec50cb9007 in term 1.
I20260807 19:50:48.060299 32146 leader_election.cc:302] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 3e90b00be5aa495f8b578afcb65ccb85, de8f213706a24134a0f7c6ec50cb9007; no voters:
I20260807 19:50:48.060778 32369 raft_consensus.cc:2781] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:50:48.061550 32369 raft_consensus.cc:686] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 1 LEADER]: Becoming Leader. State: Replica: de8f213706a24134a0f7c6ec50cb9007, State: Running, Role: LEADER
I20260807 19:50:48.062429 32369 consensus_queue.cc:237] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } }
I20260807 19:50:48.068459 31546 catalog_manager.cc:5495] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 reported cstate change: term changed from 0 to 1, leader changed from <none> to de8f213706a24134a0f7c6ec50cb9007 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "de8f213706a24134a0f7c6ec50cb9007" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "de8f213706a24134a0f7c6ec50cb9007" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 39891 } health_report { overall_health: HEALTHY } } }
I20260807 19:50:48.128158 32353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.121561 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40536 (local address 127.12.155.131:39891)
0807 19:50:48.121747 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:48.121751 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:48.122134 (+ 383us) server_negotiation.cc:407] Connection header received
0807 19:50:48.122254 (+ 120us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:48.122259 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:48.122373 (+ 114us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:48.122520 (+ 147us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:50:48.122962 (+ 442us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.123897 (+ 935us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.125553 (+ 1656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.126235 (+ 682us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.126340 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.126960 (+ 620us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:50:48.127572 (+ 612us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:50:48.127693 (+ 121us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:48.127842 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 19:50:48.127916 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:50:48.138253 32038 raft_consensus.cc:1261] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 1 FOLLOWER]: Refusing update from remote peer de8f213706a24134a0f7c6ec50cb9007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:50:48.138341 31807 raft_consensus.cc:1261] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 1 FOLLOWER]: Refusing update from remote peer de8f213706a24134a0f7c6ec50cb9007: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:50:48.139461 32376 consensus_queue.cc:1035] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "063decd7f41b4c479caa59d951597840" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37573 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:50:48.139986 32369 consensus_queue.cc:1035] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [LEADER]: Connected to new peer: Peer: permanent_uuid: "3e90b00be5aa495f8b578afcb65ccb85" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 35189 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:50:48.154124 32379 mvcc.cc:205] Tried to move back new op lower bound from 7315997688362369024 to 7315997688069259264. Current Snapshot: MvccSnapshot[applied={T|T < 7315997688362369024}]
I20260807 19:50:48.172926 31546 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:50:48.173372 31546 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:44656:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:50:48.177982 31546 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 5f6fa905277c44f98ca58d055587fdcc: Sending DeleteTablet for 3 replicas of tablet 1fbab5e1b9b4433cba6fad9d099eda14
I20260807 19:50:48.179208 32012 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fbab5e1b9b4433cba6fad9d099eda14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:50:48 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:44194
I20260807 19:50:48.180609 31780 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fbab5e1b9b4433cba6fad9d099eda14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:50:48 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:55484
I20260807 19:50:48.182116 32394 tablet_replica.cc:330] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: stopping tablet replica
I20260807 19:50:48.182458 32219 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fbab5e1b9b4433cba6fad9d099eda14 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:50:48 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:40528
I20260807 19:50:48.182577 32394 raft_consensus.cc:2229] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:50:48.183238 32394 raft_consensus.cc:2258] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:50:48.184783 32396 tablet_replica.cc:330] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: stopping tablet replica
I20260807 19:50:48.185878 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 31659
I20260807 19:50:48.186478 32396 raft_consensus.cc:2229] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:50:48.187042 32396 raft_consensus.cc:2258] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:50:48.190943 32396 ts_tablet_manager.cc:1905] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:50:48.197991 32394 ts_tablet_manager.cc:1905] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:50:48.200573 32396 ts_tablet_manager.cc:1918] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:50:48.200837 32396 log.cc:1196] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/1fbab5e1b9b4433cba6fad9d099eda14
I20260807 19:50:48.201606 32396 ts_tablet_manager.cc:1939] T 1fbab5e1b9b4433cba6fad9d099eda14 P 063decd7f41b4c479caa59d951597840: Deleting consensus metadata
I20260807 19:50:48.203652 31519 catalog_manager.cc:4841] TS 063decd7f41b4c479caa59d951597840 (127.12.155.129:37573): tablet 1fbab5e1b9b4433cba6fad9d099eda14 (table test-table [id=275e63152d7642fbb9cf26fcb441fd3c]) successfully deleted
I20260807 19:50:48.203935 32398 tablet_replica.cc:330] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: stopping tablet replica
I20260807 19:50:48.204412 32398 raft_consensus.cc:2229] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:50:48.205230 32398 raft_consensus.cc:2258] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:50:48.207269 32398 ts_tablet_manager.cc:1905] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:50:48.207806 32394 ts_tablet_manager.cc:1918] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:50:48.207978 32394 log.cc:1196] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/1fbab5e1b9b4433cba6fad9d099eda14
I20260807 19:50:48.208488 32394 ts_tablet_manager.cc:1939] T 1fbab5e1b9b4433cba6fad9d099eda14 P 3e90b00be5aa495f8b578afcb65ccb85: Deleting consensus metadata
I20260807 19:50:48.210423 31522 catalog_manager.cc:4841] TS 3e90b00be5aa495f8b578afcb65ccb85 (127.12.155.130:35189): tablet 1fbab5e1b9b4433cba6fad9d099eda14 (table test-table [id=275e63152d7642fbb9cf26fcb441fd3c]) successfully deleted
I20260807 19:50:48.213603 32398 ts_tablet_manager.cc:1918] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:50:48.213796 32398 log.cc:1196] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegration.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/1fbab5e1b9b4433cba6fad9d099eda14
I20260807 19:50:48.214411 32398 ts_tablet_manager.cc:1939] T 1fbab5e1b9b4433cba6fad9d099eda14 P de8f213706a24134a0f7c6ec50cb9007: Deleting consensus metadata
Aug 07 19:50:48 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:50:48.216158 31519 catalog_manager.cc:4841] TS de8f213706a24134a0f7c6ec50cb9007 (127.12.155.131:39891): tablet 1fbab5e1b9b4433cba6fad9d099eda14 (table test-table [id=275e63152d7642fbb9cf26fcb441fd3c]) successfully deleted
I20260807 19:50:48.223392 32352 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.189522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55492 (local address 127.12.155.129:37573)
0807 19:50:48.189702 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:48.189708 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:48.204268 (+ 14560us) server_negotiation.cc:407] Connection header received
0807 19:50:48.204686 (+ 418us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:48.204693 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:48.204804 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:48.204887 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:48.206882 (+ 1995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.208005 (+ 1123us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.210054 (+ 2049us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.210726 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.210858 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.216476 (+ 5618us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:48.216493 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:48.216511 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:48.216559 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:48.220309 (+ 3750us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:48.221097 (+ 788us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:48.221108 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:48.221112 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:48.221274 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:48.221676 (+ 402us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:48.221682 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:48.221686 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:48.222220 (+ 534us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:48.222523 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:48.222777 (+ 254us) server_negotiation.cc:299] Negotiation successful
0807 19:50:48.223000 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:50:48.224193 31872 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:50:48.316470 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 31659
I20260807 19:50:48.345347 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 31890
Aug 07 19:50:48 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:50:48.363550 32350 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.346220 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44210 (local address 127.12.155.130:35189)
0807 19:50:48.346410 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:48.346415 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:48.346495 (+ 80us) server_negotiation.cc:407] Connection header received
0807 19:50:48.346676 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:48.346680 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:48.346757 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:48.346842 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:48.348665 (+ 1823us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.349471 (+ 806us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.351408 (+ 1937us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.351859 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.351973 (+ 114us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.357243 (+ 5270us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:48.357258 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:48.357274 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:48.357310 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:48.360569 (+ 3259us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:48.361253 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:48.361261 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:48.361263 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:48.361433 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:48.361846 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:48.361852 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:48.361855 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:48.362327 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:48.362642 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:48.362947 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 19:50:48.363188 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:50:48.364249 32107 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:50:48.456578 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 31890
I20260807 19:50:48.484349 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 32123
Aug 07 19:50:48 dist-test-slave-2p8l krb5kdc[30775](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132243, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:50:48.502839 32353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:50:48.485322 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40542 (local address 127.12.155.131:39891)
0807 19:50:48.485533 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:50:48.485539 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:50:48.485562 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:50:48.485828 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:50:48.485834 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:50:48.485927 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:50:48.486103 (+ 176us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:50:48.487523 (+ 1420us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.488405 (+ 882us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.489843 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:50:48.490504 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:50:48.490673 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:50:48.495769 (+ 5096us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:50:48.495785 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:50:48.495802 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:50:48.495851 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:50:48.499519 (+ 3668us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:48.500296 (+ 777us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:48.500303 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:48.500306 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:48.500477 (+ 171us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:50:48.500928 (+ 451us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:50:48.500934 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:50:48.500940 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:50:48.501378 (+ 438us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:50:48.501815 (+ 437us) server_negotiation.cc:1035] Waiting for connection context
0807 19:50:48.502167 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 19:50:48.502423 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:50:48.503692 32322 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:50:48.629047 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 32123
I20260807 19:50:48.660404 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 31495
I20260807 19:50:48.661854 31591 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:50:48.781621 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 31495
I20260807 19:50:48.817759 12910 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 19:50:49.163295 12910 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 19:50:49.163643 12910 mini_ranger.cc:66] Stopping Ranger...
I20260807 19:50:49.519738 12910 mini_ranger.cc:68] Stopped Ranger
2026-08-07 19:50:49.520 UTC [30823] LOG: received smart shutdown request
2026-08-07 19:50:49.524 UTC [30823] LOG: background worker "logical replication launcher" (PID 30843) exited with exit code 1
2026-08-07 19:50:49.525 UTC [30831] LOG: shutting down
2026-08-07 19:50:49.715 UTC [30823] LOG: database system is shut down
2026-08-07T19:50:49Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegration (54100 ms)
[ RUN ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:50:49 dist-test-slave-2p8l krb5kdc[32423](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:50:49 dist-test-slave-2p8l krb5kdc[32423](info): set up 2 sockets
Aug 07 19:50:49 dist-test-slave-2p8l krb5kdc[32423](info): commencing operation
krb5kdc: starting...
W20260807 19:50:51.338359 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.438s user 0.003s sys 0.034s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:50:51 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132251, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:50:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:50:51Z Disabled control of system clock
WARNING: no policy specified for rangeradmin/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangeradmin/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangeradmin/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/rangeradmin_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal rangeradmin/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/rangeradmin_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for rangerlookup/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerlookup/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerlookup/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/rangerlookup_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal rangerlookup/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/rangerlookup_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "HTTP/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
I20260807 19:50:51.741571 12910 mini_postgres.cc:62] Running initdb...
The files belonging to this database system will be owned by user "slave".
This user must also own the server process.
The database cluster will be initialized with locale "C".
The default database encoding has accordingly been set to "SQL_ASCII".
The default text search configuration will be set to "english".
Data page checksums are disabled.
creating directory /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/postgres ... ok
creating subdirectories ... ok
selecting dynamic shared memory implementation ... posix
selecting default max_connections ... 100
selecting default shared_buffers ... 128MB
selecting default time zone ... Etc/UTC
creating configuration files ... ok
running bootstrap script ... ok
performing post-bootstrap initialization ... ok
syncing data to disk ... ok
initdb: warning: enabling "trust" authentication for local connections
You can change this by editing pg_hba.conf or using the option -A, or
--auth-local and --auth-host, the next time you run initdb.
Success. You can now start the database server using:
/tmp/dist-test-taskviQnk1/build/asan/bin/postgres/pg_ctl -D /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/postgres -l logfile start
2026-08-07 19:50:54.380 UTC [32484] LOG: starting PostgreSQL 12.2 on x86_64-pc-linux-gnu, compiled by cc (GCC) 8.3.1 20190311 (Red Hat 8.3.1-3), 64-bit
2026-08-07 19:50:54.380 UTC [32484] LOG: listening on IPv4 address "127.12.155.148", port 49089
2026-08-07 19:50:54.384 UTC [32484] LOG: listening on Unix socket "/tmp/.s.PGSQL.49089"
2026-08-07 19:50:54.408 UTC [32489] LOG: database system was shut down at 2026-08-07 19:50:52 UTC
2026-08-07 19:50:54.412 UTC [32484] LOG: database system is ready to accept connections
I20260807 19:50:55.622503 12910 mini_postgres.cc:96] Postgres bound to 49089
2026-08-07 19:50:55.651 UTC [32504] FATAL: database "slave" does not exist
127.12.155.148:49089 - accepting connections
I20260807 19:50:55.652640 12910 mini_ranger.cc:161] Starting Ranger...
I20260807 19:50:55.699469 12910 mini_ranger.cc:84] Created miniranger Postgres user
I20260807 19:50:56.230597 12910 mini_ranger.cc:87] Created ranger Postgres database
I20260807 19:50:56.230732 12910 mini_ranger.cc:178] Starting Ranger out of /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-admin
2026-08-07 19:50:56,557 [I] DB FLAVOR :POSTGRES
2026-08-07 19:50:56,558 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:50:56,558 [I] Checking connection..
2026-08-07 19:50:56,558 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select 1;"
2026-08-07 19:50:56,830 [I] Checking connection passed.
2026-08-07 19:50:56,830 [I] --------- Verifying version history table ---------
2026-08-07 19:50:56,830 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:50:57,103 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:50:57,103 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:50:57,373 [I] Table x_db_version_h does not exist in database ranger
2026-08-07 19:50:57,373 [I] Importing x_db_version_h table schema to database ranger from file: create_dbversion_catalog.sql
2026-08-07 19:50:57,373 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/db/postgres/create_dbversion_catalog.sql
2026-08-07 19:50:57.626 UTC [32617] WARNING: there is no transaction in progress
2026-08-07 19:50:57,634 [I] create_dbversion_catalog.sql file imported successfully
2026-08-07 19:50:57,634 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_db_version_h') as temp;"
2026-08-07 19:50:57,894 [I] Table x_db_version_h already exists in database 'ranger'
2026-08-07 19:50:57,894 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:50:57,894 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'Y';"
2026-08-07 19:50:58,162 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'CORE_DB_SCHEMA' and active = 'N';"
2026-08-07 19:50:58,434 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "insert into x_db_version_h (version, inst_at, inst_by, updated_at, updated_by,active) values ('CORE_DB_SCHEMA', current_timestamp, 'Ranger 2.1.0', current_timestamp, 'dist-test-slave-2p8l.c.gcp-upstream.internal','N') ;"
2026-08-07 19:50:58,678 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:50:58,942 [I] Table x_portal_user does not exist in database ranger
2026-08-07 19:50:58,942 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:50:59,216 [I] Table x_policy_ref_group does not exist in database ranger
2026-08-07 19:50:59,217 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:50:59,486 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:50:59,754 [I] Importing DB schema to database ranger from file: ranger_core_db_postgres.sql
2026-08-07 19:50:59,754 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/db/postgres/optimized/current/ranger_core_db_postgres.sql
2026-08-07 19:51:00.756 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.773 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.791 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.806 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.823 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.842 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.901 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.908 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.922 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.932 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.943 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.962 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.972 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.978 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.985 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:00.992 UTC [328] WARNING: there is no transaction in progress
2026-08-07 19:51:01,658 [I] ranger_core_db_postgres.sql file imported successfully
2026-08-07 19:51:01,658 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set inst_by='Ranger 2.1.0' where active='Y' and updated_by='localhost';"
2026-08-07 19:51:01,926 [I] Patches status entries updated from base ranger version to current installed ranger version:Ranger 2.1.0
2026-08-07 19:51:01,926 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_portal_user') as temp;"
2026-08-07 19:51:02,204 [I] Table x_portal_user already exists in database 'ranger'
2026-08-07 19:51:02,205 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='ranger' and table_name = 'x_policy_ref_group') as temp;"
2026-08-07 19:51:02,447 [I] Table x_policy_ref_group already exists in database 'ranger'
2026-08-07 19:51:02,447 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and active = 'Y';"
2026-08-07 19:51:02,682 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'JAVA_PATCHES' and active = 'Y';"
2026-08-07 19:51:02,977 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "update x_db_version_h set active='Y' where version='CORE_DB_SCHEMA' and active='N' and updated_by='dist-test-slave-2p8l.c.gcp-upstream.internal';"
2026-08-07 19:51:03,275 [I] CORE_DB_SCHEMA import status has been updated
2026-08-07 19:51:03,276 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/ranger -u miniranger -p '********' -noheader -trim -c \; -query "select version from x_db_version_h where version = 'DB_PATCHES' and inst_by = 'Ranger 2.1.0' and active = 'Y';"
2026-08-07 19:51:03,573 [I] DB_PATCHES have already been applied
I20260807 19:51:03.579777 12910 mini_ranger.cc:191] Using Ranger class path: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-admin:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/ews/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*:/tmp/dist-test-taskviQnk1/thirdparty/src/hadoop-3.2.0/*:/tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-admin/ews/webapp
I20260807 19:51:03.579893 12910 mini_ranger.cc:193] Using host: 127.12.155.148
I20260807 19:51:03.601092 12910 mini_ranger.cc:227] Ranger admin URL: http://127.12.155.148:34137
Aug 07, 2026 7:51:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:51:03 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:51:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Deriving webapp folder from catalina.base property. folder=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp
Aug 07, 2026 7:51:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp, webAppName = /
Aug 07, 2026 7:51:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp] .....
Aug 07, 2026 7:51:04 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-admin/ews/webapp].
Aug 07, 2026 7:51:04 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : miniranger
I20260807 19:51:04.982842 12910 mini_ranger.cc:160] Time spent starting Ranger: real 9.330s user 0.004s sys 0.061s
Aug 07, 2026 7:51:26 PM com.sun.jersey.api.core.PackagesResourceConfig init
INFO: Scanning for root resource and provider classes in the packages:
org.apache.ranger.rest
org.apache.ranger.common
xa.rest
Aug 07, 2026 7:51:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Root resource classes found:
class org.apache.ranger.rest.MetricsREST
class org.apache.ranger.rest.XKeyREST
class org.apache.ranger.rest.XAuditREST
class org.apache.ranger.rest.XUserREST
class org.apache.ranger.rest.UserREST
class org.apache.ranger.rest.ServiceREST
class org.apache.ranger.rest.PublicAPIs
class org.apache.ranger.rest.TagREST
class org.apache.ranger.rest.AssetREST
class org.apache.ranger.rest.RoleREST
class org.apache.ranger.rest.SecurityZoneREST
class org.apache.ranger.rest.PublicAPIsv2
Aug 07, 2026 7:51:26 PM com.sun.jersey.api.core.ScanningResourceConfig logClasses
INFO: Provider classes found:
class org.apache.ranger.common.RangerJAXBContextResolver
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.servlet.SpringServlet getContext
INFO: Using default applicationContext
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, assetREST, of type org.apache.ranger.rest.AssetREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, metricsREST, of type org.apache.ranger.rest.MetricsREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIs, of type org.apache.ranger.rest.PublicAPIs as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, publicAPIsv2, of type org.apache.ranger.rest.PublicAPIsv2 as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, roleREST, of type org.apache.ranger.rest.RoleREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, securityZoneREST, of type org.apache.ranger.rest.SecurityZoneREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, serviceREST, of type org.apache.ranger.rest.ServiceREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, tagREST, of type org.apache.ranger.rest.TagREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, userREST, of type org.apache.ranger.rest.UserREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XAuditREST, of type org.apache.ranger.rest.XAuditREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XKeyREST, of type org.apache.ranger.rest.XKeyREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.spi.spring.container.SpringComponentProviderFactory registerSpringBeans
INFO: Registering Spring bean, XUserREST, of type org.apache.ranger.rest.XUserREST as a root resource class
Aug 07, 2026 7:51:26 PM com.sun.jersey.server.impl.application.WebApplicationImpl _initiate
INFO: Initiating Jersey application, version 'Jersey: 1.19.3 10/24/2016 03:58 PM'
Aug 07, 2026 7:51:27 PM com.sun.jersey.spi.inject.Errors processErrorMessages
WARNING: The following warnings have been detected with resource and/or provider classes:
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInExcel(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInJson(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse,java.lang.Boolean), MUST return a non-void type.
WARNING: A HTTP GET method, public void org.apache.ranger.rest.ServiceREST.getPoliciesInCsv(javax.servlet.http.HttpServletRequest,javax.servlet.http.HttpServletResponse) throws java.io.IOException, MUST return a non-void type.
I20260807 19:51:27.662259 12910 mini_ranger.cc:261] Created Kudu service
WARNING: no policy specified for rangerkms/127.12.155.148@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "rangerkms/127.12.155.148@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal rangerkms/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/rangerkms_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal rangerkms/127.12.155.148@KRBTEST.COM with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/rangerkms_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for HTTP/127.12.155.148@KRBTEST.COM; defaulting to no policy
add_principal: Principal or policy already exists while creating "HTTP/127.12.155.148@KRBTEST.COM".
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 3, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
Entry for principal HTTP/127.12.155.148@KRBTEST.COM with kvno 3, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/HTTP_127.12.155.148@KRBTEST.COM.keytab.
WARNING: no policy specified for keyadmin@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "keyadmin@KRBTEST.COM" created.
Aug 07 19:51:27 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132287, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for keyadmin@KRBTEST.COM:
I20260807 19:51:27.861470 12910 mini_ranger_kms.cc:208] Starting Ranger KMS...
I20260807 19:51:27.887554 12910 mini_ranger_kms.cc:78] Created minirangerkms Postgres user
I20260807 19:51:28.828711 12910 mini_ranger_kms.cc:81] Created rangerkms Postgres database
I20260807 19:51:28.828841 12910 mini_ranger_kms.cc:226] Starting Ranger KMS out of /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms
I20260807 19:51:28.828888 12910 mini_ranger_kms.cc:227] Using postgres at 127.12.155.148:49089
2026-08-07 19:51:29,203 [I] DB FLAVOR :POSTGRES
2026-08-07 19:51:29,204 [I] --------- Verifying Ranger DB connection ---------
2026-08-07 19:51:29,204 [I] Checking connection
2026-08-07 19:51:29,204 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "SELECT 1;"
2026-08-07 19:51:29,450 [I] connection success
2026-08-07 19:51:29,450 [I] --------- Verifying Ranger DB tables ---------
2026-08-07 19:51:29,450 [I] Verifying table ranger_masterkey in database rangerkms
2026-08-07 19:51:29,450 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -query "select * from (select table_name from information_schema.tables where table_catalog='rangerkms' and table_name = 'ranger_masterkey') as temp;"
2026-08-07 19:51:29,726 [I] Table ranger_masterkey does not exist in database rangerkms
2026-08-07 19:51:29,727 [I] --------- Importing Ranger Core DB Schema ---------
2026-08-07 19:51:29,727 [I] Importing db schema to database rangerkms from file: kms_core_db_postgres.sql
2026-08-07 19:51:29,727 [JISQL] /usr/lib/jvm/java-1.8.0-openjdk-amd64/bin/java -cp /tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/jisql/lib/* org.apache.util.sql.Jisql -driver postgresql -cstring jdbc:postgresql://127.12.155.148:49089/rangerkms -u rangerkms -p '********' -noheader -trim -c \; -input /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/db/postgres/kms_core_db_postgres.sql
2026-08-07 19:51:30,017 [I] kms_core_db_postgres.sql DB schema imported successfully
I20260807 19:51:30.506337 12910 mini_ranger_kms.cc:310] Created kms service
I20260807 19:51:30.708020 12910 mini_ranger_kms.cc:326] Created kudu user
I20260807 19:51:30.753698 12910 mini_ranger_kms.cc:343] Created rangerkms user
Aug 07 19:51:30 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132287, etypes {rep=17 tkt=17 ses=17}, keyadmin@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:31.200963 12910 mini_ranger_kms.cc:384] Added ranger policy
I20260807 19:51:31.201319 12910 mini_ranger_kms.cc:238] Using RangerKMS classpath: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms:/tmp/dist-test-taskviQnk1/build/asan/bin/postgresql.jar:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/WEB-INF/classes/lib/*:/tmp/dist-test-taskviQnk1/thirdparty/src/ranger-2.1.0-kms/ews/webapp/lib/*:/usr/lib/jvm/java-1.8.0-openjdk-amd64/lib/*
I20260807 19:51:31.201386 12910 mini_ranger_kms.cc:240] Using host: 127.12.155.148
I20260807 19:51:31.222630 12910 mini_ranger_kms.cc:276] Ranger KMS PID: 614
I20260807 19:51:31.222769 12910 mini_ranger_kms.cc:277] Ranger KMS URL: http://127.12.155.148:33917
Aug 07, 2026 7:51:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getKeyManagers
WARNING: Config 'ranger.keystore.file' or 'ranger.service.https.attrib.keystore.file' is not found or contains blank value
Aug 07, 2026 7:51:32 PM org.apache.ranger.server.tomcat.EmbeddedServer getTrustManagers
WARNING: Config 'ranger.truststore.file' is not found or contains blank value!
Aug 07, 2026 7:51:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Webapp file =/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/ews/webapp, webAppName = /kms
Aug 07, 2026 7:51:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Adding webapp [/kms] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/ews/webapp] .....
Aug 07, 2026 7:51:32 PM org.apache.ranger.server.tomcat.EmbeddedServer start
INFO: Finished init of webapp [/kms] = path [/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-kms/ews/webapp].
Aug 07, 2026 7:51:32 PM org.apache.ranger.server.tomcat.EmbeddedServer startServer
INFO: Server Name : minirangerkms
Aug 07 19:51:33 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132293, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.155.148@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Aug 07 19:51:33 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132293, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.155.148@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:34.095854 12910 mini_ranger_kms.cc:207] Time spent starting Ranger KMS: real 6.234s user 0.068s sys 0.337s
I20260807 19:51:34.096091 12910 mini_ranger_kms.cc:397] {"name":"kuduclusterkey","cipher":"AES/CTR/NoPadding","length":128,"description":"kuduclusterkey"}
I20260807 19:51:34.096266 12910 mini_ranger_kms.cc:401] 127.12.155.148:33917/kms/v1/keys
Aug 07 19:51:34 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132293, etypes {rep=17 tkt=17 ses=17}, rangerkms/127.12.155.148@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
Aug 07 19:51:36 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:51:36.613730 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:37411
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:37411
--ranger_config_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:36.954135 695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:36.954429 695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:36.954519 695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:36.961871 695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:36.961982 695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:36.962028 695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:36.962150 695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:36.962205 695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:36.972422 695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
--ranger_kms_url=127.12.155.148:33917/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:37411
--ranger_config_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:37411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:36.973665 695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:36.975008 695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:36.987462 700 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:36.987507 701 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:36.987470 703 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:36.988270 695 server_base.cc:1034] running on GCE node
I20260807 19:51:36.989180 695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:36.990763 695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:36.992017 695 hybrid_clock.cc:648] HybridClock initialized: now 1786132296991970 us; error 31 us; skew 500 ppm
I20260807 19:51:36.992414 695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:36 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:36.995966 695 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:51:36.997565 695 webserver.cc:460] Webserver started at http://127.12.155.190:43151/ using document root <none> and password file <none>
I20260807 19:51:36.998368 695 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:36.998523 695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:36.998865 695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:51:36 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:37.064888 695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "877a7ee17cd14d82af8d07968b46d4a9"
format_stamp: "Formatted at 2026-08-07 19:51:37 on dist-test-slave-2p8l"
server_key: "523122863008b048cad80b2d577ebe97"
server_key_iv: "9c99f1dfe1c4bd54d7f6cbfeb63b7cf7"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:37.065819 695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "877a7ee17cd14d82af8d07968b46d4a9"
format_stamp: "Formatted at 2026-08-07 19:51:37 on dist-test-slave-2p8l"
server_key: "523122863008b048cad80b2d577ebe97"
server_key_iv: "9c99f1dfe1c4bd54d7f6cbfeb63b7cf7"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:37.071331 695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:51:37.091727 712 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:37.093436 695 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.001s
I20260807 19:51:37.093640 695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "877a7ee17cd14d82af8d07968b46d4a9"
format_stamp: "Formatted at 2026-08-07 19:51:37 on dist-test-slave-2p8l"
server_key: "523122863008b048cad80b2d577ebe97"
server_key_iv: "9c99f1dfe1c4bd54d7f6cbfeb63b7cf7"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:37.093881 695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:37.115139 695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:37.119659 695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:37.119983 695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:37.139333 695 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:37411
I20260807 19:51:37.139365 796 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:37411 every 8 connection(s)
I20260807 19:51:37.140722 695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:51:37.144495 797 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:37.145941 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 695
I20260807 19:51:37.146204 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:51:37.147089 12910 external_mini_cluster.cc:1428] Setting key 781b08ac1a229a62e0f221077d5494bd
I20260807 19:51:37.158998 797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Bootstrap starting.
Aug 07 19:51:37 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:37.162220 797 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:37.163513 797 log.cc:824] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:37.166637 797 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: No bootstrap required, opened a new log
I20260807 19:51:37.170907 802 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:37.149217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41760 (local address 127.12.155.190:37411)
0807 19:51:37.150115 (+ 898us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:37.150136 (+ 21us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:37.150179 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:51:37.151773 (+ 1594us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:37.151800 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:37.152175 (+ 375us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:37.152476 (+ 301us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:37.154186 (+ 1710us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:37.155483 (+ 1297us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:37.157393 (+ 1910us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:37.158177 (+ 784us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:37.158367 (+ 190us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:37.162432 (+ 4065us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:37.162440 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:37.162455 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:37.162496 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:37.166219 (+ 3723us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:37.167106 (+ 887us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:37.167115 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:37.167122 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:37.167302 (+ 180us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:37.167760 (+ 458us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:37.167765 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:37.167774 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:37.168354 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:37.168709 (+ 355us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:37.169247 (+ 538us) server_negotiation.cc:299] Negotiation successful
0807 19:51:37.169718 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":641,"thread_start_us":420,"threads_started":1}
I20260807 19:51:37.175377 797 raft_consensus.cc:348] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:37.175810 797 raft_consensus.cc:374] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:37.175925 797 raft_consensus.cc:729] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 877a7ee17cd14d82af8d07968b46d4a9, State: Initialized, Role: FOLLOWER
I20260807 19:51:37.176476 797 consensus_queue.cc:260] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:37.176730 797 raft_consensus.cc:388] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:51:37.176888 797 raft_consensus.cc:482] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:51:37.177073 797 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:37.179306 797 raft_consensus.cc:504] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:37.179800 797 leader_election.cc:302] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 877a7ee17cd14d82af8d07968b46d4a9; no voters:
I20260807 19:51:37.180594 797 leader_election.cc:288] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:51:37.180800 809 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:51:37.181644 809 raft_consensus.cc:686] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 LEADER]: Becoming Leader. State: Replica: 877a7ee17cd14d82af8d07968b46d4a9, State: Running, Role: LEADER
I20260807 19:51:37.182402 809 consensus_queue.cc:237] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:37.183368 797 sys_catalog.cc:564] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:37.185557 810 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 877a7ee17cd14d82af8d07968b46d4a9. Latest consensus state: current_term: 1 leader_uuid: "877a7ee17cd14d82af8d07968b46d4a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } } }
I20260807 19:51:37.185638 812 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "877a7ee17cd14d82af8d07968b46d4a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } } }
I20260807 19:51:37.186376 812 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:37.186007 810 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:37.191054 820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:51:37.196734 820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:51:37.197489 797 ranger_client.cc:318] Using new properties file: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
I20260807 19:51:37.216100 820 catalog_manager.cc:1347] Generated new cluster ID: bd7ff9b859dc4e89808f24ec874bedca
I20260807 19:51:37.216356 820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:51:37.258361 820 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:51:37.260471 820 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:51:37.269770 820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Generated new TSK 0
I20260807 19:51:37.270856 820 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:51:38.045781 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37411
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:51:38 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132298, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
W20260807 19:51:38.480156 872 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:38.480624 872 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:38.480814 872 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:38.492386 872 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:38.492642 872 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:38.492890 872 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:51:38.508831 872 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
--ranger_kms_url=127.12.155.148:33917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:38.510835 872 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:38.513017 872 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:38.537631 894 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:38.546594 897 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:38.547122 872 server_base.cc:1034] running on GCE node
W20260807 19:51:38.547701 895 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:38.548602 872 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:38.549970 872 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:38.551283 872 hybrid_clock.cc:648] HybridClock initialized: now 1786132298551215 us; error 56 us; skew 500 ppm
I20260807 19:51:38.551683 872 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:38 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132298, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:38.556061 872 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:51:38.557979 872 webserver.cc:460] Webserver started at http://127.12.155.129:32927/ using document root <none> and password file <none>
I20260807 19:51:38.558844 872 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:38.559017 872 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:38.559358 872 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:51:38 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132298, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:38.579299 872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "991c846883754673a66c7d34d871dd06"
format_stamp: "Formatted at 2026-08-07 19:51:38 on dist-test-slave-2p8l"
server_key: "9a64f609b04a4cdbe79840f1b7538271"
server_key_iv: "e04bcdfedfc322ac052218780fadf1a8"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:38.580693 872 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "991c846883754673a66c7d34d871dd06"
format_stamp: "Formatted at 2026-08-07 19:51:38 on dist-test-slave-2p8l"
server_key: "9a64f609b04a4cdbe79840f1b7538271"
server_key_iv: "e04bcdfedfc322ac052218780fadf1a8"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:38.589097 872 fs_manager.cc:691] Time spent creating directory manager: real 0.008s user 0.009s sys 0.000s
I20260807 19:51:38.617662 908 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:38.619827 872 fs_manager.cc:725] Time spent opening block manager: real 0.012s user 0.008s sys 0.002s
I20260807 19:51:38.620132 872 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "991c846883754673a66c7d34d871dd06"
format_stamp: "Formatted at 2026-08-07 19:51:38 on dist-test-slave-2p8l"
server_key: "9a64f609b04a4cdbe79840f1b7538271"
server_key_iv: "e04bcdfedfc322ac052218780fadf1a8"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:38.620497 872 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:38.657366 872 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:38.663038 872 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:38.663470 872 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:38.665105 872 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:38.671376 872 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:38.671509 872 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:38.671681 872 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:38.671758 872 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:38.734185 872 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:38483
I20260807 19:51:38.734236 1088 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:38483 every 8 connection(s)
I20260807 19:51:38.735982 872 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:51:38.743556 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 872
I20260807 19:51:38.743819 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:51:38.744948 12910 external_mini_cluster.cc:1428] Setting key b04edc239a6066f1cdb26adb9d79a85b
Aug 07 19:51:38 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132298, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
Aug 07 19:51:38 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132298, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
I20260807 19:51:38.792738 1095 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:38.742545 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37411 (local address 127.12.155.129:39947)
0807 19:51:38.760841 (+ 18296us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:38.760915 (+ 74us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:38.763949 (+ 3034us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:38.765178 (+ 1229us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:38.765194 (+ 16us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:38.765835 (+ 641us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:38.766693 (+ 858us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:38.766718 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:38.771136 (+ 4418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:38.771142 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:38.773140 (+ 1998us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:38.773171 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:38.774509 (+ 1338us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:38.774517 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:38.774823 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:38.775640 (+ 817us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:38.775673 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:38.778693 (+ 3020us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:38.784644 (+ 5951us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:38.784655 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:38.784688 (+ 33us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:38.785345 (+ 657us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:38.785996 (+ 651us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:38.786002 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:38.786005 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:38.786317 (+ 312us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:38.789131 (+ 2814us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:38.789140 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:38.789641 (+ 501us) client_negotiation.cc:769] Sending connection context
0807 19:51:38.789999 (+ 358us) client_negotiation.cc:240] Negotiation successful
0807 19:51:38.790630 (+ 631us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":17899,"thread_start_us":17609,"threads_started":1}
I20260807 19:51:38.795331 1094 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:38.741820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:39947 (local address 127.12.155.190:37411)
0807 19:51:38.764598 (+ 22778us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:38.764603 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:38.764620 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:51:38.764673 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:38.764676 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:38.764747 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:38.764886 (+ 139us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:38.769522 (+ 4636us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:38.770932 (+ 1410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:38.773329 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:38.774012 (+ 683us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:38.774146 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:38.778943 (+ 4797us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:38.778953 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:38.778961 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:38.779020 (+ 59us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:38.784468 (+ 5448us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:38.785642 (+ 1174us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:38.785648 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:38.785653 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:38.785829 (+ 176us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:38.786523 (+ 694us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:38.786529 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:38.786534 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:38.786925 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:38.787071 (+ 146us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:38.794425 (+ 7354us) server_negotiation.cc:299] Negotiation successful
0807 19:51:38.794745 (+ 320us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":22664,"thread_start_us":23328,"threads_started":1}
I20260807 19:51:38.797169 1089 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37411
I20260807 19:51:38.797549 1089 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:38.798696 1089 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:38.801491 743 ts_manager.cc:194] Registered new tserver with Master: 991c846883754673a66c7d34d871dd06 (127.12.155.129:38483)
I20260807 19:51:38.803184 743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:39947
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:51:38.846243 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37411
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:51:39 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132298, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
W20260807 19:51:39.323599 1100 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:39.324019 1100 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:39.324235 1100 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:39.335995 1100 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:39.336139 1100 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:39.336375 1100 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:51:39.352142 1100 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
--ranger_kms_url=127.12.155.148:33917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:39.353937 1100 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:39.355751 1100 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:39.371824 1116 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:39.371919 1120 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:39.372145 1123 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:39.372967 1100 server_base.cc:1034] running on GCE node
I20260807 19:51:39.373577 1100 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:39.374567 1100 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:39.375797 1100 hybrid_clock.cc:648] HybridClock initialized: now 1786132299375756 us; error 53 us; skew 500 ppm
I20260807 19:51:39.376122 1100 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:39 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132299, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:39.379720 1100 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:51:39.381341 1100 webserver.cc:460] Webserver started at http://127.12.155.130:46483/ using document root <none> and password file <none>
I20260807 19:51:39.382143 1100 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:39.382306 1100 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:39.382661 1100 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:51:39 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132299, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:39.398149 1100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "87624d5e06f44ccf9af34a8b59a5e7ee"
format_stamp: "Formatted at 2026-08-07 19:51:39 on dist-test-slave-2p8l"
server_key: "d2c8771a737237304805ac7458baa21b"
server_key_iv: "032f9ff62e37305140031ef213d5f588"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:39.399227 1100 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "87624d5e06f44ccf9af34a8b59a5e7ee"
format_stamp: "Formatted at 2026-08-07 19:51:39 on dist-test-slave-2p8l"
server_key: "d2c8771a737237304805ac7458baa21b"
server_key_iv: "032f9ff62e37305140031ef213d5f588"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:39.405236 1100 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.003s sys 0.003s
I20260807 19:51:39.423235 1139 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:39.425122 1100 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:51:39.425400 1100 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "87624d5e06f44ccf9af34a8b59a5e7ee"
format_stamp: "Formatted at 2026-08-07 19:51:39 on dist-test-slave-2p8l"
server_key: "d2c8771a737237304805ac7458baa21b"
server_key_iv: "032f9ff62e37305140031ef213d5f588"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:39.425678 1100 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:39.471676 1100 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:39.476032 1100 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:39.476365 1100 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:39.477406 1100 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:39.478855 1100 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:39.478930 1100 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:39.479061 1100 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:39.479116 1100 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:39.520473 1100 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34705
I20260807 19:51:39.520569 1339 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34705 every 8 connection(s)
I20260807 19:51:39.521833 1100 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:51:39.522480 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 1100
I20260807 19:51:39.522692 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:51:39.523481 12910 external_mini_cluster.cc:1428] Setting key f8e25d3059581d1a622f865e72908831
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Aug 07 19:51:39 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132299, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:39.574538 1342 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:39.526390 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:36073 (local address 127.12.155.190:37411)
0807 19:51:39.550464 (+ 24074us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:39.550472 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:39.554109 (+ 3637us) server_negotiation.cc:407] Connection header received
0807 19:51:39.554732 (+ 623us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:39.554738 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:39.554830 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:39.554918 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:39.557786 (+ 2868us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:39.558922 (+ 1136us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:39.561406 (+ 2484us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:39.562209 (+ 803us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:39.562389 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:39.566967 (+ 4578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:39.566974 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:39.566978 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:39.567019 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:39.570623 (+ 3604us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:39.571635 (+ 1012us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:39.571641 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:39.571645 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:39.571796 (+ 151us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:39.572348 (+ 552us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:39.572353 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:39.572356 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:39.572713 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:39.572855 (+ 142us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:39.573841 (+ 986us) server_negotiation.cc:299] Negotiation successful
0807 19:51:39.574139 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":23940,"thread_start_us":27779,"threads_started":1}
I20260807 19:51:39.575683 1344 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:39.526742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37411 (local address 127.12.155.130:36073)
0807 19:51:39.550041 (+ 23299us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:39.551506 (+ 1465us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:39.554384 (+ 2878us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:39.555492 (+ 1108us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:39.555505 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:39.556159 (+ 654us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:39.556995 (+ 836us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:39.557020 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:39.559166 (+ 2146us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:39.559172 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:39.561185 (+ 2013us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:39.561232 (+ 47us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:39.562522 (+ 1290us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:39.562529 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:39.562821 (+ 292us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:39.563565 (+ 744us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:39.563598 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:39.566705 (+ 3107us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:39.570781 (+ 4076us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:39.570793 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:39.570814 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:39.571488 (+ 674us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:39.571931 (+ 443us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:39.571939 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:39.571946 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:39.572213 (+ 267us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:39.572871 (+ 658us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:39.572882 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:39.573371 (+ 489us) client_negotiation.cc:769] Sending connection context
0807 19:51:39.573705 (+ 334us) client_negotiation.cc:240] Negotiation successful
0807 19:51:39.574333 (+ 628us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":22859,"thread_start_us":23578,"threads_started":1}
I20260807 19:51:39.577404 1340 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37411
I20260807 19:51:39.577780 1340 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:39.578704 1340 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:39.580333 743 ts_manager.cc:194] Registered new tserver with Master: 87624d5e06f44ccf9af34a8b59a5e7ee (127.12.155.130:34705)
I20260807 19:51:39.581338 743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:36073
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:51:39.605738 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37411
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:51:39.807109 1089 heartbeater.cc:503] Master 127.12.155.190:37411 was elected leader, sending a full tablet report...
W20260807 19:51:39.968040 1350 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:39.968353 1350 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:39.968528 1350 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:39.975919 1350 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:39.976063 1350 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:39.976248 1350 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:51:39.986375 1350 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
--ranger_kms_url=127.12.155.148:33917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:39.987738 1350 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:39.989032 1350 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:40.002673 1358 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:40.002720 1357 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:40.002620 1363 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:40.003652 1350 server_base.cc:1034] running on GCE node
I20260807 19:51:40.004266 1350 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:40.005349 1350 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:40.006595 1350 hybrid_clock.cc:648] HybridClock initialized: now 1786132300006553 us; error 70 us; skew 500 ppm
I20260807 19:51:40.006935 1350 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:40 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132300, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:40.010389 1350 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:51:40.012046 1350 webserver.cc:460] Webserver started at http://127.12.155.131:46073/ using document root <none> and password file <none>
I20260807 19:51:40.012749 1350 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:40.012897 1350 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:40.013223 1350 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
Aug 07 19:51:40 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132300, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:40.030608 1350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f"
format_stamp: "Formatted at 2026-08-07 19:51:40 on dist-test-slave-2p8l"
server_key: "548218fee5bb6d99c99573e70375d1b5"
server_key_iv: "3808ccb1be76ba542a32743108ef2a9e"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:40.031414 1350 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f"
format_stamp: "Formatted at 2026-08-07 19:51:40 on dist-test-slave-2p8l"
server_key: "548218fee5bb6d99c99573e70375d1b5"
server_key_iv: "3808ccb1be76ba542a32743108ef2a9e"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:40.036909 1350 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:51:40.055339 1374 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:40.056929 1350 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:51:40.057124 1350 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f"
format_stamp: "Formatted at 2026-08-07 19:51:40 on dist-test-slave-2p8l"
server_key: "548218fee5bb6d99c99573e70375d1b5"
server_key_iv: "3808ccb1be76ba542a32743108ef2a9e"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:40.057396 1350 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:40.074257 1350 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:40.078486 1350 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:40.078801 1350 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:40.079794 1350 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:40.081223 1350 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:40.081329 1350 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:40.081485 1350 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:40.081561 1350 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:40.116766 1350 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:38355
I20260807 19:51:40.116822 1571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:38355 every 8 connection(s)
I20260807 19:51:40.118278 1350 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:51:40.118770 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 1350
I20260807 19:51:40.118978 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:51:40.119771 12910 external_mini_cluster.cc:1428] Setting key 7ea832d4cf9147b3e3bf59cd295ffb9f
Aug 07 19:51:40 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132300, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:40.140228 1576 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:40.121158 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:50627 (local address 127.12.155.190:37411)
0807 19:51:40.122231 (+ 1073us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:40.122240 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:40.122980 (+ 740us) server_negotiation.cc:407] Connection header received
0807 19:51:40.125078 (+ 2098us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:40.125084 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:40.125179 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:40.125307 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:40.126957 (+ 1650us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.127840 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.129519 (+ 1679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.130145 (+ 626us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.130281 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:40.133834 (+ 3553us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:40.133839 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:40.133842 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:40.133873 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:40.136952 (+ 3079us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.137692 (+ 740us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.137696 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.137698 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.137830 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.138330 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.138335 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.138337 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.138671 (+ 334us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:40.138862 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:40.139599 (+ 737us) server_negotiation.cc:299] Negotiation successful
0807 19:51:40.139852 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":939,"thread_start_us":716,"threads_started":1}
I20260807 19:51:40.140924 1577 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:40.121918 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37411 (local address 127.12.155.131:50627)
0807 19:51:40.122831 (+ 913us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:40.122872 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:40.124786 (+ 1914us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:40.125560 (+ 774us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:40.125568 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:40.126172 (+ 604us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:40.126780 (+ 608us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:40.126798 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.128020 (+ 1222us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.128024 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:40.129349 (+ 1325us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:40.129375 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.130390 (+ 1015us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.130400 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:40.130658 (+ 258us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:40.131388 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:40.131411 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:40.133564 (+ 2153us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:40.137097 (+ 3533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:40.137104 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:40.137115 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:40.137583 (+ 468us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:40.137925 (+ 342us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:40.137928 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:40.137930 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:40.138196 (+ 266us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:40.138829 (+ 633us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:40.138835 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:40.139147 (+ 312us) client_negotiation.cc:769] Sending connection context
0807 19:51:40.139381 (+ 234us) client_negotiation.cc:240] Negotiation successful
0807 19:51:40.139779 (+ 398us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":611,"thread_start_us":351,"threads_started":1}
I20260807 19:51:40.143350 1574 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37411
I20260807 19:51:40.143697 1574 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:40.144524 1574 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:40.146147 743 ts_manager.cc:194] Registered new tserver with Master: e39dfb6e8a3443b3b1e6869d8a02e90f (127.12.155.131:38355)
I20260807 19:51:40.147431 743 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:50627
I20260807 19:51:40.148509 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:51:40.150241 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 872
Aug 07 19:51:40 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:51:40.167747 1580 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:40.151119 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38394 (local address 127.12.155.129:38483)
0807 19:51:40.151780 (+ 661us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:40.151787 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:40.151811 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:51:40.151869 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:40.151875 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:40.152056 (+ 181us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:40.152185 (+ 129us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:40.153780 (+ 1595us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.154842 (+ 1062us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.156330 (+ 1488us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.156965 (+ 635us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.157076 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:40.161397 (+ 4321us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:40.161410 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:40.161424 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:40.161458 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:40.164800 (+ 3342us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.165521 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.165538 (+ 17us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.165540 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.165693 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.166226 (+ 533us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.166229 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.166231 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.166594 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:40.166832 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:40.167247 (+ 415us) server_negotiation.cc:299] Negotiation successful
0807 19:51:40.167452 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":514,"thread_start_us":347,"threads_started":1}
I20260807 19:51:40.169027 1080 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:40.251736 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 872
I20260807 19:51:40.277597 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 1100
Aug 07 19:51:40 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:51:40.300173 1584 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:40.278688 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42134 (local address 127.12.155.130:34705)
0807 19:51:40.279212 (+ 524us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:40.279220 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:40.279245 (+ 25us) server_negotiation.cc:407] Connection header received
0807 19:51:40.279324 (+ 79us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:40.279331 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:40.279555 (+ 224us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:40.279744 (+ 189us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:40.281153 (+ 1409us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.282351 (+ 1198us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.283868 (+ 1517us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.284596 (+ 728us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.284759 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:40.293927 (+ 9168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:40.293942 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:40.293958 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:40.293999 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:40.297037 (+ 3038us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.297779 (+ 742us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.297786 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.297789 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.297980 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.298470 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.298473 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.298476 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.299022 (+ 546us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:40.299257 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:40.299528 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 19:51:40.299808 (+ 280us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":383,"thread_start_us":267,"threads_started":1}
I20260807 19:51:40.301525 1332 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:40.385542 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 1100
I20260807 19:51:40.408999 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 1350
Aug 07 19:51:40 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132296, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:51:40.425412 1588 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:40.410041 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39914 (local address 127.12.155.131:38355)
0807 19:51:40.410727 (+ 686us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:40.410734 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:40.410763 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:51:40.410823 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:40.410830 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:40.411056 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:40.411192 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:40.412444 (+ 1252us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.413502 (+ 1058us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.414958 (+ 1456us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:40.415503 (+ 545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:40.415610 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:40.419930 (+ 4320us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:40.419941 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:40.419954 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:40.419990 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:40.422875 (+ 2885us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.423588 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.423596 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.423598 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.423727 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:40.424066 (+ 339us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:40.424069 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:40.424071 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:40.424388 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:40.424648 (+ 260us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:40.424922 (+ 274us) server_negotiation.cc:299] Negotiation successful
0807 19:51:40.425130 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":530,"thread_start_us":319,"threads_started":1}
I20260807 19:51:40.426800 1559 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:40.509600 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 1350
I20260807 19:51:40.532580 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 695
I20260807 19:51:40.534193 788 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:40.643817 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 695
I20260807 19:51:40.681944 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:37411
--webserver_interface=127.12.155.190
--webserver_port=43151
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:37411
--ranger_config_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-client
--trusted_user_acl=test-admin
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:41.017469 1592 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:41.017768 1592 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:41.017951 1592 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:41.025345 1592 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:41.025449 1592 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:41.025558 1592 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:41.025660 1592 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:41.025751 1592 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:41.035966 1592 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms
--trusted_user_acl=<redacted>
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:37411
--ranger_config_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ranger-client
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:37411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=43151
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:41.037266 1592 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:41.038636 1592 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:41.052057 1599 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:41.053350 1592 server_base.cc:1034] running on GCE node
W20260807 19:51:41.053642 1598 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:41.054090 1601 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:41.055254 1592 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:41.057310 1592 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:41.058609 1592 hybrid_clock.cc:648] HybridClock initialized: now 1786132301058529 us; error 58 us; skew 500 ppm
I20260807 19:51:41.059203 1592 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:41 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132301, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:41.068473 1592 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:51:41.070479 1592 webserver.cc:460] Webserver started at http://127.12.155.190:43151/ using document root <none> and password file <none>
I20260807 19:51:41.071197 1592 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:41.071362 1592 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:51:41 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132301, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:41.158416 1592 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:51:41.161582 1613 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:41.163012 1592 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:41.163240 1592 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "877a7ee17cd14d82af8d07968b46d4a9"
format_stamp: "Formatted at 2026-08-07 19:51:37 on dist-test-slave-2p8l"
server_key: "523122863008b048cad80b2d577ebe97"
server_key_iv: "9c99f1dfe1c4bd54d7f6cbfeb63b7cf7"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:41.164206 1592 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:41.185849 1592 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:41.190086 1592 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:41.190399 1592 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:41.209511 1592 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:37411
I20260807 19:51:41.209533 1698 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:37411 every 8 connection(s)
I20260807 19:51:41.211131 1592 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:51:41.217825 1699 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:51:41.219774 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 1592
I20260807 19:51:41.220675 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:38483
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:37411
--webserver_port=32927
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:51:41.221203 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Bootstrap starting.
I20260807 19:51:41.239847 1699 log.cc:824] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:41.249013 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=3 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:51:41.249565 1699 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Bootstrap complete.
I20260807 19:51:41.258781 1699 raft_consensus.cc:348] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:41.259634 1699 raft_consensus.cc:729] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 877a7ee17cd14d82af8d07968b46d4a9, State: Initialized, Role: FOLLOWER
I20260807 19:51:41.260521 1699 consensus_queue.cc:260] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:41.260938 1699 raft_consensus.cc:388] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:51:41.261087 1699 raft_consensus.cc:482] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:51:41.261276 1699 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:51:41.265352 1699 raft_consensus.cc:504] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:41.265883 1699 leader_election.cc:302] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 877a7ee17cd14d82af8d07968b46d4a9; no voters:
I20260807 19:51:41.266585 1699 leader_election.cc:288] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:51:41.266726 1706 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:51:41.268004 1706 raft_consensus.cc:686] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [term 2 LEADER]: Becoming Leader. State: Replica: 877a7ee17cd14d82af8d07968b46d4a9, State: Running, Role: LEADER
I20260807 19:51:41.268679 1706 consensus_queue.cc:237] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } }
I20260807 19:51:41.268971 1699 sys_catalog.cc:564] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:41.271751 1709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "877a7ee17cd14d82af8d07968b46d4a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } } }
I20260807 19:51:41.272231 1709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:41.276831 1712 sys_catalog.cc:455] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 877a7ee17cd14d82af8d07968b46d4a9. Latest consensus state: current_term: 2 leader_uuid: "877a7ee17cd14d82af8d07968b46d4a9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "877a7ee17cd14d82af8d07968b46d4a9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37411 } } }
I20260807 19:51:41.277843 1712 sys_catalog.cc:458] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:41.282737 1716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:51:41.289881 1716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:51:41.291828 1716 catalog_manager.cc:1259] Loaded cluster ID: bd7ff9b859dc4e89808f24ec874bedca
I20260807 19:51:41.292325 1716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:51:41.297322 1716 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:51:41.299415 1716 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Loaded TSK: 0
I20260807 19:51:41.301352 1716 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:51:41.305167 1699 ranger_client.cc:318] Using overwritten properties file: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/master-0/logs/kudu-ranger-subprocess-log4j2.properties
W20260807 19:51:41.693660 1703 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:41.694181 1703 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:41.694367 1703 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:41.706558 1703 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:41.706712 1703 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:41.706966 1703 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:51:41.724013 1703 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:38483
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=32927
--tserver_master_addrs=127.12.155.190:37411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:41.726051 1703 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:41.728046 1703 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:41.774618 1766 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:41.775760 1767 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:41.782183 1769 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:41.783209 1703 server_base.cc:1034] running on GCE node
I20260807 19:51:41.784248 1703 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:41.788203 1703 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:41.790174 1703 hybrid_clock.cc:648] HybridClock initialized: now 1786132301790090 us; error 79 us; skew 500 ppm
I20260807 19:51:41.790702 1703 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:41 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132301, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:41.795523 1703 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:51:41.827546 1703 webserver.cc:460] Webserver started at http://127.12.155.129:32927/ using document root <none> and password file <none>
I20260807 19:51:41.828873 1703 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:41.829156 1703 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:51:41 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132301, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:41.873634 1703 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:51:41.877350 1783 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:41.879073 1703 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.000s sys 0.003s
I20260807 19:51:41.879324 1703 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "991c846883754673a66c7d34d871dd06"
format_stamp: "Formatted at 2026-08-07 19:51:38 on dist-test-slave-2p8l"
server_key: "9a64f609b04a4cdbe79840f1b7538271"
server_key_iv: "e04bcdfedfc322ac052218780fadf1a8"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:41.880872 1703 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:41.910590 1703 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:41.915936 1703 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:41.916255 1703 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:41.917402 1703 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:41.919289 1703 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:41.919404 1703 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:41.919641 1703 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:41.919741 1703 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:41.983475 1703 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:38483
I20260807 19:51:41.983532 1963 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:38483 every 8 connection(s)
I20260807 19:51:41.985056 1703 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:51:41.989079 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 1703
I20260807 19:51:41.989998 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:34705
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:37411
--webserver_port=46483
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:51:42 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132301, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:42.033046 1972 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:41.988691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37411 (local address 127.12.155.129:39897)
0807 19:51:42.000191 (+ 11500us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:42.000284 (+ 93us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:42.003846 (+ 3562us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:42.007909 (+ 4063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:42.007922 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:42.008661 (+ 739us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:42.009524 (+ 863us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:42.009553 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.012272 (+ 2719us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.012281 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:42.014641 (+ 2360us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:42.014663 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.016814 (+ 2151us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.016824 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:42.017147 (+ 323us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:42.018041 (+ 894us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:42.018104 (+ 63us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:42.021270 (+ 3166us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:42.026643 (+ 5373us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:42.026654 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:42.026673 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:42.027389 (+ 716us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:42.028045 (+ 656us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:42.028053 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:42.028059 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:42.028359 (+ 300us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:42.029722 (+ 1363us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:42.029732 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:42.030250 (+ 518us) client_negotiation.cc:769] Sending connection context
0807 19:51:42.030688 (+ 438us) client_negotiation.cc:240] Negotiation successful
0807 19:51:42.031375 (+ 687us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11034,"thread_start_us":15670,"threads_started":1}
I20260807 19:51:42.035533 1971 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:41.988674 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:39897 (local address 127.12.155.190:37411)
0807 19:51:42.006001 (+ 17327us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:42.006024 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:42.006114 (+ 90us) server_negotiation.cc:407] Connection header received
0807 19:51:42.006591 (+ 477us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:42.006614 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:42.007176 (+ 562us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:42.007664 (+ 488us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:42.009815 (+ 2151us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.012030 (+ 2215us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.014895 (+ 2865us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.016143 (+ 1248us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.016359 (+ 216us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:42.021627 (+ 5268us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:42.021641 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:42.021665 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:42.021721 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:42.026398 (+ 4677us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:42.027624 (+ 1226us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:42.027635 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:42.027646 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:42.027863 (+ 217us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:42.028539 (+ 676us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:42.028547 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:42.028553 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:42.029351 (+ 798us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:42.029616 (+ 265us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:42.033761 (+ 4145us) server_negotiation.cc:299] Negotiation successful
0807 19:51:42.034205 (+ 444us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17045,"thread_start_us":16839,"threads_started":1}
I20260807 19:51:42.039954 1964 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37411
I20260807 19:51:42.040310 1964 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:42.041261 1964 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
W20260807 19:51:42.044818 1964 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:37411 (0 consecutive failures): Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:51:42.045070 1964 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:42.045387 1964 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:42.046902 1964 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:42.047267 1964 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
W20260807 19:51:42.048569 1964 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:51:42.421132 1974 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:42.421543 1974 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:42.421787 1974 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:42.434840 1974 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:42.435060 1974 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:42.435302 1974 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:51:42.452594 1974 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:34705
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=46483
--tserver_master_addrs=127.12.155.190:37411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:42.454412 1974 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:42.456300 1974 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:42.489621 1995 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:42.493439 1996 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:42.501308 1974 server_base.cc:1034] running on GCE node
W20260807 19:51:42.501773 2002 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:42.502782 1974 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:42.504148 1974 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:42.505491 1974 hybrid_clock.cc:648] HybridClock initialized: now 1786132302505419 us; error 52 us; skew 500 ppm
I20260807 19:51:42.505924 1974 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:42 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132302, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:42.510732 1974 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:51:42.512977 1974 webserver.cc:460] Webserver started at http://127.12.155.130:46483/ using document root <none> and password file <none>
I20260807 19:51:42.514041 1974 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:42.514242 1974 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:51:42 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132302, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:42.551342 1974 fs_manager.cc:709] Time spent opening directory manager: real 0.008s user 0.007s sys 0.001s
I20260807 19:51:42.555542 2018 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:42.557479 1974 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.001s
I20260807 19:51:42.557677 1974 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "87624d5e06f44ccf9af34a8b59a5e7ee"
format_stamp: "Formatted at 2026-08-07 19:51:39 on dist-test-slave-2p8l"
server_key: "d2c8771a737237304805ac7458baa21b"
server_key_iv: "032f9ff62e37305140031ef213d5f588"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:42.559247 1974 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
Aug 07 19:51:42 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (1 etypes {17}) 127.0.0.1: ISSUE: authtime 1786132302, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:42.597198 1974 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:42.603279 1974 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:42.603647 1974 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:42.605177 1974 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:42.609858 1974 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:42.609992 1974 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:42.610136 1974 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:42.610225 1974 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:42.653441 1974 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34705
I20260807 19:51:42.653519 2206 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34705 every 8 connection(s)
I20260807 19:51:42.655627 1974 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:51:42.665102 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 1974
I20260807 19:51:42.665937 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--encryption_key_provider=ranger-kms
--encryption_cluster_key_name=kuduclusterkey
--ranger_kms_url=127.12.155.148:33917/kms
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:38355
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:37411
--webserver_port=46073
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:33589
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:51:42 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132302, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:42.683185 2210 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:42.658826 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:49107 (local address 127.12.155.190:37411)
0807 19:51:42.659331 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:42.659335 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:42.660439 (+ 1104us) server_negotiation.cc:407] Connection header received
0807 19:51:42.662671 (+ 2232us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:42.662677 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:42.662770 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:42.662894 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:42.664436 (+ 1542us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.665717 (+ 1281us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.668719 (+ 3002us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.669555 (+ 836us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.669676 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:42.675097 (+ 5421us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:42.675106 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:42.675113 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:42.675160 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:42.679056 (+ 3896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:42.680052 (+ 996us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:42.680060 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:42.680065 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:42.680213 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:42.680786 (+ 573us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:42.680794 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:42.680800 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:42.681180 (+ 380us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:42.681318 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:42.682399 (+ 1081us) server_negotiation.cc:299] Negotiation successful
0807 19:51:42.682670 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":377,"thread_start_us":269,"threads_started":1}
I20260807 19:51:42.685819 2211 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:42.659460 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37411 (local address 127.12.155.130:49107)
0807 19:51:42.660275 (+ 815us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:42.660319 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:42.662394 (+ 2075us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:42.663156 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:42.663164 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:42.663593 (+ 429us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:42.664256 (+ 663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:42.664278 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.666015 (+ 1737us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.666021 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:42.668483 (+ 2462us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:42.668502 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:42.670223 (+ 1721us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:42.670234 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:42.670600 (+ 366us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:42.671508 (+ 908us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:42.671557 (+ 49us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:42.674821 (+ 3264us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:42.679243 (+ 4422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:42.679254 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:42.679274 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:42.679910 (+ 636us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:42.680360 (+ 450us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:42.680368 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:42.680374 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:42.680645 (+ 271us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:42.681426 (+ 781us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:42.681436 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:42.681917 (+ 481us) client_negotiation.cc:769] Sending connection context
0807 19:51:42.683426 (+ 1509us) client_negotiation.cc:240] Negotiation successful
0807 19:51:42.684062 (+ 636us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":567,"thread_start_us":353,"threads_started":1}
I20260807 19:51:42.687741 2207 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37411
I20260807 19:51:42.688122 2207 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:42.688982 2207 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:42.691280 1636 ts_manager.cc:194] Registered new tserver with Master: 87624d5e06f44ccf9af34a8b59a5e7ee (127.12.155.130:34705)
I20260807 19:51:42.693112 1636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:49107
I20260807 19:51:43.048727 1964 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:43.049226 1964 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:43.055441 1636 ts_manager.cc:194] Registered new tserver with Master: 991c846883754673a66c7d34d871dd06 (127.12.155.129:38483)
I20260807 19:51:43.056735 1636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:39897
Aug 07 19:51:43 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132302, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
W20260807 19:51:43.123194 2216 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:43.123724 2216 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:43.123942 2216 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:43.135632 2216 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:43.135865 2216 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:43.136117 2216 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:51:43.152107 2216 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:33589
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--encryption_cluster_key_name=kuduclusterkey
--encryption_key_provider=ranger-kms
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
--ranger_kms_url=invalid.host:1234/kms,127.12.155.148:33917/kms
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:38355
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=46073
--tserver_master_addrs=127.12.155.190:37411
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:43.154287 2216 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:43.156059 2216 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:43.201779 2224 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:43.213975 2226 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:43.214917 2233 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:43.218878 2216 server_base.cc:1034] running on GCE node
I20260807 19:51:43.219926 2216 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:43.225474 2216 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:43.226831 2216 hybrid_clock.cc:648] HybridClock initialized: now 1786132303226748 us; error 66 us; skew 500 ppm
I20260807 19:51:43.227250 2216 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:43 dist-test-slave-2p8l krb5kdc[32423](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132303, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:43.231732 2216 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:51:43.233717 2216 webserver.cc:460] Webserver started at http://127.12.155.131:46073/ using document root <none> and password file <none>
I20260807 19:51:43.234759 2216 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:43.234946 2216 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
Aug 07 19:51:43 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132303, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:43.270848 2216 fs_manager.cc:709] Time spent opening directory manager: real 0.015s user 0.006s sys 0.009s
I20260807 19:51:43.286454 2249 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:43.291689 2216 fs_manager.cc:725] Time spent opening block manager: real 0.019s user 0.011s sys 0.004s
I20260807 19:51:43.292007 2216 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f"
format_stamp: "Formatted at 2026-08-07 19:51:40 on dist-test-slave-2p8l"
server_key: "548218fee5bb6d99c99573e70375d1b5"
server_key_iv: "3808ccb1be76ba542a32743108ef2a9e"
server_key_version: "kuduclusterkey@0"
I20260807 19:51:43.293660 2216 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:43.414805 2216 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:43.420161 2216 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:43.420557 2216 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:43.428424 2216 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:43.436558 2216 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:43.436766 2216 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.001s
I20260807 19:51:43.436959 2216 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:43.437111 2216 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
Aug 07 19:51:43 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132302, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for HTTP/127.12.155.148@KRBTEST.COM
I20260807 19:51:43.697085 2207 heartbeater.cc:503] Master 127.12.155.190:37411 was elected leader, sending a full tablet report...
I20260807 19:51:43.710376 2216 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:38355
I20260807 19:51:43.710456 2451 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:38355 every 8 connection(s)
I20260807 19:51:43.712188 2216 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:51:43.715631 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 2216
Aug 07 19:51:43 dist-test-slave-2p8l krb5kdc[32423](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132303, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:43.757301 2459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.716727 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41776 (local address 127.12.155.190:37411)
0807 19:51:43.732430 (+ 15703us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:43.732439 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:43.735071 (+ 2632us) server_negotiation.cc:407] Connection header received
0807 19:51:43.735149 (+ 78us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:43.735154 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:43.735260 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:43.735374 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:43.737771 (+ 2397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.739112 (+ 1341us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.741192 (+ 2080us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.741844 (+ 652us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.741990 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.745886 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:43.745893 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:43.745898 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:43.745944 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:43.750018 (+ 4074us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:43.752854 (+ 2836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:43.752860 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:43.752864 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:43.753050 (+ 186us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:43.755684 (+ 2634us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:43.755689 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:43.755693 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:43.756040 (+ 347us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:43.756360 (+ 320us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:43.756643 (+ 283us) server_negotiation.cc:299] Negotiation successful
0807 19:51:43.756889 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15581,"thread_start_us":15448,"threads_started":1}
I20260807 19:51:43.757824 2457 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.716355 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:51649 (local address 127.12.155.190:37411)
0807 19:51:43.732012 (+ 15657us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:43.732021 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:43.733594 (+ 1573us) server_negotiation.cc:407] Connection header received
0807 19:51:43.737965 (+ 4371us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:43.737971 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:43.738115 (+ 144us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:43.738195 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:43.740579 (+ 2384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.741822 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.744238 (+ 2416us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.744936 (+ 698us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.745071 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.750214 (+ 5143us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:43.750222 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:43.750227 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:43.750270 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:43.753774 (+ 3504us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:43.754728 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:43.754733 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:43.754737 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:43.754883 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:43.755489 (+ 606us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:43.755494 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:43.755498 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:43.755847 (+ 349us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:43.755991 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:43.757010 (+ 1019us) server_negotiation.cc:299] Negotiation successful
0807 19:51:43.757238 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15487,"thread_start_us":15373,"threads_started":1}
I20260807 19:51:43.760401 2456 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.715764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37411 (local address 127.12.155.131:51649)
0807 19:51:43.733060 (+ 17296us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:43.733125 (+ 65us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:43.737620 (+ 4495us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:43.738841 (+ 1221us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:43.738852 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:43.739473 (+ 621us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:43.740321 (+ 848us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.740349 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.742052 (+ 1703us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.742074 (+ 22us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.744067 (+ 1993us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.744082 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.745389 (+ 1307us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.745398 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.745704 (+ 306us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.746504 (+ 800us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:43.746536 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:43.749891 (+ 3355us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:43.753949 (+ 4058us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:43.753958 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:43.753976 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:43.754584 (+ 608us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:43.755051 (+ 467us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:43.755057 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:43.755063 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:43.755346 (+ 283us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:43.756100 (+ 754us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:43.756108 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:43.756553 (+ 445us) client_negotiation.cc:769] Sending connection context
0807 19:51:43.757362 (+ 809us) client_negotiation.cc:240] Negotiation successful
0807 19:51:43.758161 (+ 799us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16995,"thread_start_us":16762,"threads_started":1}
I20260807 19:51:43.762311 2452 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37411
I20260807 19:51:43.762622 2452 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:43.763489 2452 heartbeater.cc:511] Master 127.12.155.190:37411 requested a full tablet report, sending...
I20260807 19:51:43.765177 1636 ts_manager.cc:194] Registered new tserver with Master: e39dfb6e8a3443b3b1e6869d8a02e90f (127.12.155.131:38355)
I20260807 19:51:43.766398 1636 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:51649
I20260807 19:51:43.777199 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:51:43.793833 2459 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.780617 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41786 (local address 127.12.155.190:37411)
0807 19:51:43.780834 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:43.780841 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:43.781319 (+ 478us) server_negotiation.cc:407] Connection header received
0807 19:51:43.781491 (+ 172us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:43.781496 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:43.781574 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:43.781681 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:43.783172 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.784235 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.785615 (+ 1380us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.786310 (+ 695us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.786431 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.789077 (+ 2646us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:43.789082 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:43.789085 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:43.789118 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:43.791621 (+ 2503us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:43.792241 (+ 620us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:43.792245 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:43.792247 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:43.792379 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:43.792698 (+ 319us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:43.792702 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:43.792704 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:43.792936 (+ 232us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:43.793127 (+ 191us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:43.793375 (+ 248us) server_negotiation.cc:299] Negotiation successful
0807 19:51:43.793537 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:51:43.798605 1636 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41786:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:51:43.806108 1636 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:51:43.846611 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.821001 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38396 (local address 127.12.155.129:38483)
0807 19:51:43.835647 (+ 14646us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:43.835655 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:43.835688 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:51:43.835814 (+ 126us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:43.835822 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:43.836452 (+ 630us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:43.836795 (+ 343us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:43.838526 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.840074 (+ 1548us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.843499 (+ 3425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.845048 (+ 1549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.845248 (+ 200us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.845435 (+ 187us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:43.846015 (+ 580us) server_negotiation.cc:299] Negotiation successful
0807 19:51:43.846220 (+ 205us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14437,"thread_start_us":14252,"threads_started":1}
I20260807 19:51:43.846781 2492 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.820256 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38396)
0807 19:51:43.834809 (+ 14553us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:43.834838 (+ 29us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:43.834979 (+ 141us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:43.837042 (+ 2063us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:43.837047 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:43.837080 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:43.838242 (+ 1162us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.838264 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.840218 (+ 1954us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.840225 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.843301 (+ 3076us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.843327 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.845333 (+ 2006us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.845340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.845624 (+ 284us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.845755 (+ 131us) client_negotiation.cc:769] Sending connection context
0807 19:51:43.845898 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 19:51:43.846173 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":14363,"mutex_wait_us":403,"spinlock_wait_cycles":1408,"thread_start_us":15270,"threads_started":1}
I20260807 19:51:43.847290 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.821762 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38355 (local address 127.0.0.1:39918)
0807 19:51:43.835714 (+ 13952us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:43.835732 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:43.835849 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:43.837010 (+ 1161us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:43.837018 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:43.837068 (+ 50us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:43.838251 (+ 1183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.838264 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.841315 (+ 3051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.841322 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.843343 (+ 2021us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.843356 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.845342 (+ 1986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.845346 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.845622 (+ 276us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.845755 (+ 133us) client_negotiation.cc:769] Sending connection context
0807 19:51:43.845898 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 19:51:43.846173 (+ 275us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":13807,"mutex_wait_us":99,"spinlock_wait_cycles":6784,"thread_start_us":13304,"threads_started":1}
I20260807 19:51:43.847540 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.822298 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39918 (local address 127.12.155.131:38355)
0807 19:51:43.835225 (+ 12927us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:43.835238 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:43.835843 (+ 605us) server_negotiation.cc:407] Connection header received
0807 19:51:43.836041 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:43.836050 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:43.836255 (+ 205us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:43.836478 (+ 223us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:43.840209 (+ 3731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.841178 (+ 969us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.843554 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.845037 (+ 1483us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.845247 (+ 210us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.845435 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:43.846980 (+ 1545us) server_negotiation.cc:299] Negotiation successful
0807 19:51:43.847146 (+ 166us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":12681,"thread_start_us":12522,"threads_started":1}
I20260807 19:51:43.848587 2486 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.819602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:34705 (local address 127.0.0.1:42150)
0807 19:51:43.821338 (+ 1736us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:43.821389 (+ 51us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:43.821542 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:43.837013 (+ 15471us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:43.837017 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:43.837198 (+ 181us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:43.837865 (+ 667us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.837881 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.840187 (+ 2306us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.840194 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.843339 (+ 3145us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:43.843350 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.847783 (+ 4433us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.847789 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:43.847933 (+ 144us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.847956 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 19:51:43.848079 (+ 123us) client_negotiation.cc:240] Negotiation successful
0807 19:51:43.848213 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1492,"mutex_wait_us":197,"spinlock_wait_cycles":2816,"thread_start_us":1353,"threads_started":1}
I20260807 19:51:43.848642 2488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:43.819815 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42150 (local address 127.12.155.130:34705)
0807 19:51:43.836387 (+ 16572us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:43.836395 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:43.836421 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:51:43.836515 (+ 94us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:43.836524 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:43.836767 (+ 243us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:43.837291 (+ 524us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:43.838286 (+ 995us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.839976 (+ 1690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.845540 (+ 5564us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:43.847248 (+ 1708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:43.847439 (+ 191us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:43.847617 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:43.848127 (+ 510us) server_negotiation.cc:299] Negotiation successful
0807 19:51:43.848290 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16388,"thread_start_us":16224,"threads_started":1}
I20260807 19:51:43.851676 2331 tablet_service.cc:1467] Processing CreateTablet for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c (DEFAULT_TABLE table=test-table [id=978ae20b99324c5c94c327cf23075d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:43.851666 1864 tablet_service.cc:1467] Processing CreateTablet for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c (DEFAULT_TABLE table=test-table [id=978ae20b99324c5c94c327cf23075d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:43.852113 2101 tablet_service.cc:1467] Processing CreateTablet for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c (DEFAULT_TABLE table=test-table [id=978ae20b99324c5c94c327cf23075d8a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:43.853271 2331 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:43.853291 1864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:43.853299 2101 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:43.866919 2495 tablet_bootstrap.cc:492] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Bootstrap starting.
I20260807 19:51:43.868323 2496 tablet_bootstrap.cc:492] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Bootstrap starting.
I20260807 19:51:43.872205 2496 tablet_bootstrap.cc:654] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:43.872570 2495 tablet_bootstrap.cc:654] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:43.873728 2495 log.cc:824] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:43.873728 2496 log.cc:824] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:43.874679 2497 tablet_bootstrap.cc:492] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Bootstrap starting.
I20260807 19:51:43.877753 2495 tablet_bootstrap.cc:492] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: No bootstrap required, opened a new log
I20260807 19:51:43.878052 2496 tablet_bootstrap.cc:492] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: No bootstrap required, opened a new log
I20260807 19:51:43.878024 2495 ts_tablet_manager.cc:1397] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Time spent bootstrapping tablet: real 0.011s user 0.003s sys 0.004s
I20260807 19:51:43.878139 2497 tablet_bootstrap.cc:654] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:43.878336 2496 ts_tablet_manager.cc:1397] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 19:51:43.879240 2497 log.cc:824] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:43.881637 2497 tablet_bootstrap.cc:492] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: No bootstrap required, opened a new log
I20260807 19:51:43.881879 2497 ts_tablet_manager.cc:1397] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Time spent bootstrapping tablet: real 0.007s user 0.003s sys 0.003s
I20260807 19:51:43.889039 2496 raft_consensus.cc:348] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:43.889039 2495 raft_consensus.cc:348] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:43.889487 2496 raft_consensus.cc:374] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:43.889484 2495 raft_consensus.cc:374] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:43.889595 2495 raft_consensus.cc:729] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 991c846883754673a66c7d34d871dd06, State: Initialized, Role: FOLLOWER
I20260807 19:51:43.889662 2496 raft_consensus.cc:729] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 87624d5e06f44ccf9af34a8b59a5e7ee, State: Initialized, Role: FOLLOWER
I20260807 19:51:43.889518 2497 raft_consensus.cc:348] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:43.889973 2497 raft_consensus.cc:374] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:43.890100 2497 raft_consensus.cc:729] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e39dfb6e8a3443b3b1e6869d8a02e90f, State: Initialized, Role: FOLLOWER
I20260807 19:51:43.890306 2496 consensus_queue.cc:260] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:43.890306 2495 consensus_queue.cc:260] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:43.890717 2497 consensus_queue.cc:260] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:43.892208 2496 ts_tablet_manager.cc:1428] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Time spent starting tablet: real 0.014s user 0.009s sys 0.004s
I20260807 19:51:43.892477 2495 ts_tablet_manager.cc:1428] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 19:51:43.892671 1964 heartbeater.cc:503] Master 127.12.155.190:37411 was elected leader, sending a full tablet report...
I20260807 19:51:43.894135 2452 heartbeater.cc:503] Master 127.12.155.190:37411 was elected leader, sending a full tablet report...
I20260807 19:51:43.894659 2497 ts_tablet_manager.cc:1428] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Time spent starting tablet: real 0.013s user 0.012s sys 0.001s
W20260807 19:51:43.908229 2208 tablet.cc:2369] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:51:43.985384 2453 tablet.cc:2369] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:51:43.987986 1969 tablet.cc:2369] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:51:44.017941 2506 raft_consensus.cc:482] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:51:44.018255 2506 raft_consensus.cc:504] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:44.019904 2506 leader_election.cc:288] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 87624d5e06f44ccf9af34a8b59a5e7ee (127.12.155.130:34705), e39dfb6e8a3443b3b1e6869d8a02e90f (127.12.155.131:38355)
I20260807 19:51:44.027202 2488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.020466 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:48807 (local address 127.12.155.130:34705)
0807 19:51:44.020725 (+ 259us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:44.020731 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:44.020977 (+ 246us) server_negotiation.cc:407] Connection header received
0807 19:51:44.021256 (+ 279us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:44.021265 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:44.021362 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:44.021461 (+ 99us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:44.022264 (+ 803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.023245 (+ 981us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.025209 (+ 1964us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.026165 (+ 956us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.026286 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.026338 (+ 52us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:44.026796 (+ 458us) server_negotiation.cc:299] Negotiation successful
0807 19:51:44.026944 (+ 148us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:51:44.027390 2508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.020170 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:34705 (local address 127.12.155.129:48807)
0807 19:51:44.020860 (+ 690us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.020883 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:44.021087 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:44.021583 (+ 496us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:44.021587 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:44.021611 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:44.022094 (+ 483us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:44.022109 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.023395 (+ 1286us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.023401 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:44.025050 (+ 1649us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:44.025062 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.026378 (+ 1316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.026387 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:44.026634 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.026660 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 19:51:44.026739 (+ 79us) client_negotiation.cc:240] Negotiation successful
0807 19:51:44.026826 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":555,"mutex_wait_us":5,"spinlock_wait_cycles":26880,"thread_start_us":379,"threads_started":1}
I20260807 19:51:44.027500 2513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.020908 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38355 (local address 127.12.155.129:56483)
0807 19:51:44.021665 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.021679 (+ 14us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:44.021803 (+ 124us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:44.022265 (+ 462us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:44.022270 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:44.022294 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:44.022687 (+ 393us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:44.022699 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.023835 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.023839 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:44.025338 (+ 1499us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:44.025352 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.026554 (+ 1202us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.026559 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:44.026783 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.026818 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:51:44.026913 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 19:51:44.027030 (+ 117us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":623,"mutex_wait_us":44,"spinlock_wait_cycles":896,"thread_start_us":426,"threads_started":1}
I20260807 19:51:44.027345 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.021281 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:56483 (local address 127.12.155.131:38355)
0807 19:51:44.021491 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:44.021496 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:44.021776 (+ 280us) server_negotiation.cc:407] Connection header received
0807 19:51:44.021940 (+ 164us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:44.021945 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:44.022103 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:44.022243 (+ 140us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:44.022842 (+ 599us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.023701 (+ 859us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.025495 (+ 1794us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.026345 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.026505 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.026579 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:44.026969 (+ 390us) server_negotiation.cc:299] Negotiation successful
0807 19:51:44.027118 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 19:51:44.028530 2130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4cf5b19300d4cc58c60ab72ff6b9b3c" candidate_uuid: "991c846883754673a66c7d34d871dd06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" is_pre_election: true
I20260807 19:51:44.028568 2374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4cf5b19300d4cc58c60ab72ff6b9b3c" candidate_uuid: "991c846883754673a66c7d34d871dd06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" is_pre_election: true
I20260807 19:51:44.029050 2374 raft_consensus.cc:2454] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 991c846883754673a66c7d34d871dd06 in term 0.
I20260807 19:51:44.029034 2130 raft_consensus.cc:2454] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 991c846883754673a66c7d34d871dd06 in term 0.
I20260807 19:51:44.029693 1785 leader_election.cc:302] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87624d5e06f44ccf9af34a8b59a5e7ee, 991c846883754673a66c7d34d871dd06; no voters:
I20260807 19:51:44.030164 2506 raft_consensus.cc:2781] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:51:44.030311 2506 raft_consensus.cc:482] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:51:44.030428 2506 raft_consensus.cc:3037] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:44.032613 2506 raft_consensus.cc:504] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:44.033131 2506 leader_election.cc:288] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [CANDIDATE]: Term 1 election: Requested vote from peers 87624d5e06f44ccf9af34a8b59a5e7ee (127.12.155.130:34705), e39dfb6e8a3443b3b1e6869d8a02e90f (127.12.155.131:38355)
I20260807 19:51:44.033591 2130 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4cf5b19300d4cc58c60ab72ff6b9b3c" candidate_uuid: "991c846883754673a66c7d34d871dd06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee"
I20260807 19:51:44.033708 2374 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c4cf5b19300d4cc58c60ab72ff6b9b3c" candidate_uuid: "991c846883754673a66c7d34d871dd06" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f"
I20260807 19:51:44.033805 2130 raft_consensus.cc:3037] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:44.033936 2374 raft_consensus.cc:3037] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:44.036053 2130 raft_consensus.cc:2454] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 991c846883754673a66c7d34d871dd06 in term 1.
I20260807 19:51:44.036262 2374 raft_consensus.cc:2454] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 991c846883754673a66c7d34d871dd06 in term 1.
I20260807 19:51:44.036484 1785 leader_election.cc:302] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 87624d5e06f44ccf9af34a8b59a5e7ee, 991c846883754673a66c7d34d871dd06; no voters:
I20260807 19:51:44.036778 2506 raft_consensus.cc:2781] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:51:44.037220 2506 raft_consensus.cc:686] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 1 LEADER]: Becoming Leader. State: Replica: 991c846883754673a66c7d34d871dd06, State: Running, Role: LEADER
I20260807 19:51:44.037740 2506 consensus_queue.cc:237] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } }
I20260807 19:51:44.041993 1636 catalog_manager.cc:5495] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 reported cstate change: term changed from 0 to 1, leader changed from <none> to 991c846883754673a66c7d34d871dd06 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "991c846883754673a66c7d34d871dd06" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "991c846883754673a66c7d34d871dd06" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 38483 } health_report { overall_health: HEALTHY } } }
I20260807 19:51:44.069247 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.063679 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38402 (local address 127.12.155.129:38483)
0807 19:51:44.063905 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:44.063910 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:44.063930 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:51:44.064163 (+ 233us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:44.064168 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:44.064247 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:44.064405 (+ 158us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:51:44.064812 (+ 407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.065600 (+ 788us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.067038 (+ 1438us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.067442 (+ 404us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.067610 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.068119 (+ 509us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:51:44.068606 (+ 487us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:51:44.068791 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:44.068893 (+ 102us) server_negotiation.cc:299] Negotiation successful
0807 19:51:44.068976 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:51:44.077502 2130 raft_consensus.cc:1261] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 1 FOLLOWER]: Refusing update from remote peer 991c846883754673a66c7d34d871dd06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:51:44.077540 2374 raft_consensus.cc:1261] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 1 FOLLOWER]: Refusing update from remote peer 991c846883754673a66c7d34d871dd06: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:51:44.078516 2514 consensus_queue.cc:1035] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "87624d5e06f44ccf9af34a8b59a5e7ee" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34705 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:51:44.078958 2506 consensus_queue.cc:1035] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e39dfb6e8a3443b3b1e6869d8a02e90f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38355 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:51:44.092214 2518 mvcc.cc:205] Tried to move back new op lower bound from 7315997917491339264 to 7315997917342531584. Current Snapshot: MvccSnapshot[applied={T|T < 7315997917491339264}]
I20260807 19:51:44.094856 2519 mvcc.cc:205] Tried to move back new op lower bound from 7315997917491339264 to 7315997917342531584. Current Snapshot: MvccSnapshot[applied={T|T < 7315997917491339264}]
I20260807 19:51:44.108325 1636 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:51:44.108598 1636 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:41786:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:51:44.112038 1636 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 877a7ee17cd14d82af8d07968b46d4a9: Sending DeleteTablet for 3 replicas of tablet c4cf5b19300d4cc58c60ab72ff6b9b3c
I20260807 19:51:44.113235 1864 tablet_service.cc:1514] Processing DeleteTablet for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:51:44 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:38396
I20260807 19:51:44.113299 2331 tablet_service.cc:1514] Processing DeleteTablet for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:51:44 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:39918
I20260807 19:51:44.120435 2101 tablet_service.cc:1514] Processing DeleteTablet for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:51:44 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:42150
I20260807 19:51:44.124320 2532 tablet_replica.cc:330] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: stopping tablet replica
I20260807 19:51:44.124513 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 1703
I20260807 19:51:44.124984 2531 tablet_replica.cc:330] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: stopping tablet replica
I20260807 19:51:44.126853 2532 raft_consensus.cc:2229] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:51:44.127427 2532 raft_consensus.cc:2258] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:51:44.127797 2531 raft_consensus.cc:2229] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:51:44.129571 2531 raft_consensus.cc:2258] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:51:44.130664 2533 tablet_replica.cc:330] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: stopping tablet replica
I20260807 19:51:44.131026 2533 raft_consensus.cc:2229] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:51:44.131488 2533 raft_consensus.cc:2258] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:51:44.133750 2533 ts_tablet_manager.cc:1905] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:44.133795 2531 ts_tablet_manager.cc:1905] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 991c846883754673a66c7d34d871dd06: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:44.134100 2532 ts_tablet_manager.cc:1905] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:44.140110 2532 ts_tablet_manager.cc:1918] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:51:44.140347 2532 log.cc:1196] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/c4cf5b19300d4cc58c60ab72ff6b9b3c
I20260807 19:51:44.140959 2532 ts_tablet_manager.cc:1939] T c4cf5b19300d4cc58c60ab72ff6b9b3c P e39dfb6e8a3443b3b1e6869d8a02e90f: Deleting consensus metadata
I20260807 19:51:44.143018 1615 catalog_manager.cc:4841] TS e39dfb6e8a3443b3b1e6869d8a02e90f (127.12.155.131:38355): tablet c4cf5b19300d4cc58c60ab72ff6b9b3c (table test-table [id=978ae20b99324c5c94c327cf23075d8a]) successfully deleted
I20260807 19:51:44.144404 2533 ts_tablet_manager.cc:1918] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:51:44.144632 2533 log.cc:1196] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/c4cf5b19300d4cc58c60ab72ff6b9b3c
I20260807 19:51:44.145331 2533 ts_tablet_manager.cc:1939] T c4cf5b19300d4cc58c60ab72ff6b9b3c P 87624d5e06f44ccf9af34a8b59a5e7ee: Deleting consensus metadata
I20260807 19:51:44.145968 2490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.125736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38404 (local address 127.12.155.129:38483)
0807 19:51:44.125893 (+ 157us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:44.125901 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:44.125959 (+ 58us) server_negotiation.cc:407] Connection header received
0807 19:51:44.126211 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:44.126218 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:44.126307 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:44.126427 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:44.128173 (+ 1746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.129014 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.130914 (+ 1900us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.131555 (+ 641us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.131697 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.135215 (+ 3518us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:44.135233 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:44.135253 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:44.135298 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:44.139466 (+ 4168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:44.140350 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:44.140358 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:44.140362 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:44.140571 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:44.143891 (+ 3320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:44.143897 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:44.143901 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:44.144393 (+ 492us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:44.144784 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:44.145244 (+ 460us) server_negotiation.cc:299] Negotiation successful
0807 19:51:44.145567 (+ 323us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:51:44.146867 1956 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:44.147302 1615 catalog_manager.cc:4841] TS 87624d5e06f44ccf9af34a8b59a5e7ee (127.12.155.130:34705): tablet c4cf5b19300d4cc58c60ab72ff6b9b3c (table test-table [id=978ae20b99324c5c94c327cf23075d8a]) successfully deleted
I20260807 19:51:44.245374 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 1703
W20260807 19:51:44.269001 1618 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:38483 (error 108)
I20260807 19:51:44.269148 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 1974
I20260807 19:51:44.271047 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.270609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38406)
0807 19:51:44.270782 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.270881 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 19:51:44.271306 1618 catalog_manager.cc:4584] TS 991c846883754673a66c7d34d871dd06 (127.12.155.129:38483): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet c4cf5b19300d4cc58c60ab72ff6b9b3c: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
I20260807 19:51:44.283399 2488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.269989 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42166 (local address 127.12.155.130:34705)
0807 19:51:44.270199 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:44.270203 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:44.270242 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:51:44.270498 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:44.270504 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:44.270591 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:44.270718 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:44.272654 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.273372 (+ 718us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.274871 (+ 1499us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.275397 (+ 526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.275495 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.277989 (+ 2494us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:44.278002 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:44.278016 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:44.278047 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:44.280766 (+ 2719us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:44.281405 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:44.281413 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:44.281415 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:44.281593 (+ 178us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:44.281903 (+ 310us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:44.281907 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:44.281909 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:44.282346 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:44.282584 (+ 238us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:44.282837 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 19:51:44.282997 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":95}
I20260807 19:51:44.284121 2202 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:44.324908 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.324314 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38408)
0807 19:51:44.324578 (+ 264us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.324705 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 19:51:44.326027 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.325621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38410)
0807 19:51:44.325781 (+ 160us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.325884 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:51:44.374302 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 1974
I20260807 19:51:44.386670 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.386214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38412)
0807 19:51:44.386414 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.386511 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:51:44.387691 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.387346 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38416)
0807 19:51:44.387497 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.387579 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:51:44.400980 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 2216
I20260807 19:51:44.414726 2493 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.401726 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39924 (local address 127.12.155.131:38355)
0807 19:51:44.401891 (+ 165us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:44.401895 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:44.401913 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:51:44.402052 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:44.402094 (+ 42us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:44.402176 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:44.402259 (+ 83us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:44.403556 (+ 1297us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.404248 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.405496 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:44.405887 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:44.405977 (+ 90us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:44.408745 (+ 2768us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:44.408760 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:44.408778 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:44.408815 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:44.411714 (+ 2899us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:44.412526 (+ 812us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:44.412534 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:44.412537 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:44.412698 (+ 161us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:44.413106 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:44.413110 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:44.413112 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:44.413568 (+ 456us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:44.413790 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:44.414142 (+ 352us) server_negotiation.cc:299] Negotiation successful
0807 19:51:44.414326 (+ 184us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:51:44.415366 2443 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:44.468232 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.467714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38428)
0807 19:51:44.467945 (+ 231us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.468037 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":64}
I20260807 19:51:44.469362 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.468969 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38436)
0807 19:51:44.469176 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.469254 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":102}
I20260807 19:51:44.504590 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 2216
I20260807 19:51:44.531531 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 1592
I20260807 19:51:44.532819 1694 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:44.644428 2489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:44.643729 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:38483 (local address 127.0.0.1:38446)
0807 19:51:44.643976 (+ 247us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:44.644145 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:38483: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 19:51:44.644677 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 1592
I20260807 19:51:44.681066 12910 mini_ranger_kms.cc:60] Stopping Ranger KMS...
I20260807 19:51:45.026307 12910 mini_ranger_kms.cc:62] Stopped Ranger KMS
I20260807 19:51:45.026516 12910 mini_ranger.cc:66] Stopping Ranger...
I20260807 19:51:45.381309 12910 mini_ranger.cc:68] Stopped Ranger
2026-08-07 19:51:45.381 UTC [32484] LOG: received smart shutdown request
2026-08-07 19:51:45.385 UTC [32484] LOG: background worker "logical replication launcher" (PID 32502) exited with exit code 1
2026-08-07 19:51:45.385 UTC [32490] LOG: shutting down
2026-08-07 19:51:45.563 UTC [32484] LOG: database system is shut down
2026-08-07T19:51:45Z chronyd exiting
[ OK ] SecurityITest.TestEncryptionWithKMSIntegrationMultipleServers (55835 ms)
[ RUN ] SecurityITest.IPKICACert
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:51:45 dist-test-slave-2p8l krb5kdc[2555](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:51:45 dist-test-slave-2p8l krb5kdc[2555](info): set up 2 sockets
Aug 07 19:51:45 dist-test-slave-2p8l krb5kdc[2555](info): commencing operation
krb5kdc: starting...
W20260807 19:51:47.051383 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.315s user 0.004s sys 0.029s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:51:47 dist-test-slave-2p8l krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:51:47Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:51:47Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:51:47.323552 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38143
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:38143,127.12.155.189:40991,127.12.155.188:46647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:47.659709 2578 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:47.659991 2578 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:47.660180 2578 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:47.668691 2578 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:47.668824 2578 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:47.668918 2578 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:47.669024 2578 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:47.669106 2578 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:47.679282 2578 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:38143,127.12.155.189:40991,127.12.155.188:46647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38143
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:47.680629 2578 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:47.681965 2578 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:47.694512 2585 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:47.694603 2586 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:47.694469 2588 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:47.699259 2578 server_base.cc:1034] running on GCE node
I20260807 19:51:47.700067 2578 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:47.701511 2578 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:47.702755 2578 hybrid_clock.cc:648] HybridClock initialized: now 1786132307702723 us; error 57 us; skew 500 ppm
I20260807 19:51:47.703120 2578 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:47 dist-test-slave-2p8l krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:47.712455 2578 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:51:47.714478 2578 webserver.cc:460] Webserver started at http://127.12.155.190:41531/ using document root <none> and password file <none>
I20260807 19:51:47.715685 2578 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:47.715870 2578 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:47.716223 2578 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:47.719425 2578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "d5edc15354f74ee4a851e8f868933738"
format_stamp: "Formatted at 2026-08-07 19:51:47 on dist-test-slave-2p8l"
server_key: "8abce7cf6aa8ae7d44f7a8c950ec76ac"
server_key_iv: "f12c47f5e6418dcea80cbfcc918287ac"
server_key_version: "encryptionkey@0"
I20260807 19:51:47.720299 2578 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "d5edc15354f74ee4a851e8f868933738"
format_stamp: "Formatted at 2026-08-07 19:51:47 on dist-test-slave-2p8l"
server_key: "8abce7cf6aa8ae7d44f7a8c950ec76ac"
server_key_iv: "f12c47f5e6418dcea80cbfcc918287ac"
server_key_version: "encryptionkey@0"
I20260807 19:51:47.725975 2578 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:51:47.729846 2607 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:47.731334 2578 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:47.731565 2578 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "d5edc15354f74ee4a851e8f868933738"
format_stamp: "Formatted at 2026-08-07 19:51:47 on dist-test-slave-2p8l"
server_key: "8abce7cf6aa8ae7d44f7a8c950ec76ac"
server_key_iv: "f12c47f5e6418dcea80cbfcc918287ac"
server_key_version: "encryptionkey@0"
I20260807 19:51:47.731783 2578 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:47.745591 2578 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:47.749938 2578 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:47.750305 2578 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:47.770318 2578 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:38143
I20260807 19:51:47.770349 2681 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:38143 every 8 connection(s)
I20260807 19:51:47.771732 2578 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:51:47.775564 2682 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:47.779326 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 2578
I20260807 19:51:47.779572 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:51:47.780468 12910 external_mini_cluster.cc:1428] Setting key a096cde5408284576edd82e37ac65c86
I20260807 19:51:47.784394 2682 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:51:47 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
WARNING: no policy specified for kudu/127.12.155.189@KRBTEST.COM; defaulting to no policy
I20260807 19:51:47.813148 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.788624 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38143 (local address 127.0.0.1:47712)
0807 19:51:47.790689 (+ 2065us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.790746 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:47.792741 (+ 1995us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:47.794173 (+ 1432us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:47.794183 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:47.795093 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:47.795611 (+ 518us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:47.795643 (+ 32us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:47.797233 (+ 1590us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:47.797241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:47.799248 (+ 2007us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:47.799267 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:47.800263 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:47.800272 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:47.800524 (+ 252us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:47.801305 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:47.801340 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:47.804094 (+ 2754us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:47.808721 (+ 4627us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:47.808733 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:47.808744 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:47.809187 (+ 443us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:47.809733 (+ 546us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:47.809741 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:47.809744 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:47.809915 (+ 171us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:47.811034 (+ 1119us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:47.811041 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:47.811254 (+ 213us) client_negotiation.cc:769] Sending connection context
0807 19:51:47.811526 (+ 272us) client_negotiation.cc:240] Negotiation successful
0807 19:51:47.811959 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1786,"thread_start_us":1515,"threads_started":1}
I20260807 19:51:47.813169 2687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.788625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47712 (local address 127.12.155.190:38143)
0807 19:51:47.793468 (+ 4843us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:47.793474 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:47.793507 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:51:47.793647 (+ 140us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:47.793652 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:47.793874 (+ 222us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:47.794043 (+ 169us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:47.795833 (+ 1790us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:47.797059 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:47.799412 (+ 2353us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:47.800005 (+ 593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:47.800140 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:47.804361 (+ 4221us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:47.804370 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:47.804383 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:47.804411 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:47.808548 (+ 4137us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:47.809368 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:47.809377 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:47.809381 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:47.809589 (+ 208us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:47.810088 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:47.810095 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:47.810100 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:47.810872 (+ 772us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:47.811098 (+ 226us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:47.811721 (+ 623us) server_negotiation.cc:299] Negotiation successful
0807 19:51:47.812196 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":174,"server-negotiator.queue_time_us":4650,"thread_start_us":4415,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.189@KRBTEST.COM" created.
I20260807 19:51:47.816339 2682 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:51:47.817549 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.817024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59572)
0807 19:51:47.817238 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.817388 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
W20260807 19:51:47.817823 2612 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
I20260807 19:51:47.819746 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.819223 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59588)
0807 19:51:47.819414 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.819554 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 19:51:47.819970 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40991: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab.
Entry for principal kudu/127.12.155.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab.
I20260807 19:51:47.847131 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:40991
--webserver_interface=127.12.155.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab
--principal=kudu/127.12.155.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:38143,127.12.155.189:40991,127.12.155.188:46647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:51:47.869352 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } attempt: 1
I20260807 19:51:47.870800 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.870337 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59604)
0807 19:51:47.870547 (+ 210us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.870663 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 19:51:47.871780 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.871431 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59618)
0807 19:51:47.871577 (+ 146us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.871652 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 19:51:47.871971 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40991: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
I20260807 19:51:47.940246 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } attempt: 2
I20260807 19:51:47.941607 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.941007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59622)
0807 19:51:47.941289 (+ 282us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.941386 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":84}
I20260807 19:51:47.942816 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:47.942379 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59638)
0807 19:51:47.942564 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:47.942651 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:51:47.943034 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40991: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
I20260807 19:51:48.034286 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } attempt: 3
I20260807 19:51:48.035449 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.035007 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59644)
0807 19:51:48.035227 (+ 220us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.035322 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 19:51:48.036557 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.036200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59654)
0807 19:51:48.036352 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.036437 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 19:51:48.036742 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40991: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
I20260807 19:51:48.179967 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } attempt: 4
I20260807 19:51:48.181173 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.180672 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59658)
0807 19:51:48.180955 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.181038 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":134}
I20260807 19:51:48.182212 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.181792 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59674)
0807 19:51:48.181943 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.182032 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 19:51:48.182396 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40991: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40991: connect: Connection refused (error 111)
W20260807 19:51:48.184305 2695 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:48.184638 2695 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:48.184823 2695 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:48.192258 2695 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:48.192399 2695 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:48.192497 2695 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:48.192584 2695 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:48.192652 2695 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:48.202661 2695 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:38143,127.12.155.189:40991,127.12.155.188:46647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab
--principal=kudu/127.12.155.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:40991
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.155.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:48.203994 2695 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:48.205336 2695 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:48.217335 2705 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:48.217271 2709 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:48.217237 2707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:48.218103 2695 server_base.cc:1034] running on GCE node
I20260807 19:51:48.218883 2695 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:48.220263 2695 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:48.221469 2695 hybrid_clock.cc:648] HybridClock initialized: now 1786132308221415 us; error 53 us; skew 500 ppm
I20260807 19:51:48.221832 2695 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:48.225135 2695 init.cc:377] Logged in from keytab as kudu/127.12.155.189@KRBTEST.COM (short username kudu)
I20260807 19:51:48.226579 2695 webserver.cc:460] Webserver started at http://127.12.155.189:32771/ using document root <none> and password file <none>
I20260807 19:51:48.227209 2695 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:48.227308 2695 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:48.227550 2695 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:48.230587 2695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data/instance:
uuid: "78e0783922f04b9ba8ae639d3a8689e0"
format_stamp: "Formatted at 2026-08-07 19:51:48 on dist-test-slave-2p8l"
server_key: "37708710f53982e127d7a75ac3a5ce81"
server_key_iv: "5589c36d8ee56fdc65c5845db70f54fe"
server_key_version: "encryptionkey@0"
I20260807 19:51:48.231427 2695 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal/instance:
uuid: "78e0783922f04b9ba8ae639d3a8689e0"
format_stamp: "Formatted at 2026-08-07 19:51:48 on dist-test-slave-2p8l"
server_key: "37708710f53982e127d7a75ac3a5ce81"
server_key_iv: "5589c36d8ee56fdc65c5845db70f54fe"
server_key_version: "encryptionkey@0"
I20260807 19:51:48.236909 2695 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:51:48.240453 2724 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:48.241879 2695 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260807 19:51:48.242120 2695 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal
uuid: "78e0783922f04b9ba8ae639d3a8689e0"
format_stamp: "Formatted at 2026-08-07 19:51:48 on dist-test-slave-2p8l"
server_key: "37708710f53982e127d7a75ac3a5ce81"
server_key_iv: "5589c36d8ee56fdc65c5845db70f54fe"
server_key_version: "encryptionkey@0"
I20260807 19:51:48.242333 2695 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:48.266034 2695 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:48.270911 2695 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:48.271215 2695 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:48.291023 2695 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.189:40991
I20260807 19:51:48.291062 2800 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.189:40991 every 8 connection(s)
I20260807 19:51:48.292421 2695 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
I20260807 19:51:48.296123 2805 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:48.302774 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 2695
I20260807 19:51:48.302975 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-1/wal/instance
I20260807 19:51:48.302700 2805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:51:48.303409 12910 external_mini_cluster.cc:1428] Setting key 1d5aad3adf13a8cb0dfd8d70e98fe4ab
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:48.325429 2687 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.305382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47722 (local address 127.12.155.190:38143)
0807 19:51:48.305628 (+ 246us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.305636 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.306899 (+ 1263us) server_negotiation.cc:407] Connection header received
0807 19:51:48.308741 (+ 1842us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.308750 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.308848 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.308980 (+ 132us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.310578 (+ 1598us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.311642 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.313205 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.313949 (+ 744us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.314121 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.318042 (+ 3921us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.318052 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.318099 (+ 47us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.318150 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.322034 (+ 3884us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.322830 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.322838 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.322844 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.322993 (+ 149us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.323414 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.323422 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.323427 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.323835 (+ 408us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.323989 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.324736 (+ 747us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.324993 (+ 257us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:51:48.326171 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.305860 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38143 (local address 127.0.0.1:47722)
0807 19:51:48.306714 (+ 854us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.306768 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.308460 (+ 1692us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.309223 (+ 763us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.309231 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.309754 (+ 523us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.310388 (+ 634us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.310406 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.311816 (+ 1410us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.311820 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.313052 (+ 1232us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.313066 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.314249 (+ 1183us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.314254 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.314443 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.315201 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.315235 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.317799 (+ 2564us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.322225 (+ 4426us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.322232 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.322245 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.322682 (+ 437us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.323110 (+ 428us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.323113 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.323116 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.323289 (+ 173us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.323966 (+ 677us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.323989 (+ 23us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.324312 (+ 323us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.324558 (+ 246us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.324935 (+ 377us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":587,"thread_start_us":399,"threads_started":1}
I20260807 19:51:48.328202 2805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.155.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.188@KRBTEST.COM" created.
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:51:48.346146 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.328947 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59682)
0807 19:51:48.329761 (+ 814us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.329783 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.329900 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.330483 (+ 583us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.330488 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.330980 (+ 492us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.331191 (+ 211us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.331207 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.332780 (+ 1573us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.332784 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.333856 (+ 1072us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.333869 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.334931 (+ 1062us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.334939 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.335217 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.335909 (+ 692us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.335938 (+ 29us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.338649 (+ 2711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.343243 (+ 4594us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.343251 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.343254 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.343662 (+ 408us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.344083 (+ 421us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.344086 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.344089 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.344228 (+ 139us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.345001 (+ 773us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.345008 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.345174 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.345338 (+ 164us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.345668 (+ 330us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":638}
I20260807 19:51:48.346309 2810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.329217 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59682 (local address 127.12.155.189:40991)
0807 19:51:48.329979 (+ 762us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.329985 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.330012 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:51:48.330125 (+ 113us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.330132 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.330312 (+ 180us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.330431 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.331397 (+ 966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.332633 (+ 1236us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.334016 (+ 1383us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.334763 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.334869 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.338881 (+ 4012us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.338898 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.338920 (+ 22us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.338969 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.343035 (+ 4066us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.343799 (+ 764us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.343810 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.343815 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.343961 (+ 146us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.344336 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.344344 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.344350 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.344843 (+ 493us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.345004 (+ 161us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.345633 (+ 629us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.345868 (+ 235us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":601,"thread_start_us":478,"threads_started":1}
I20260807 19:51:48.348644 2805 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:51:48.349905 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.349457 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45494)
0807 19:51:48.349671 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.349770 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
W20260807 19:51:48.350253 2726 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.351789 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.351479 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45508)
0807 19:51:48.351628 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.351699 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 19:51:48.352141 2805 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab.
Entry for principal kudu/127.12.155.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab.
I20260807 19:51:48.369297 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:46647
--webserver_interface=127.12.155.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab
--principal=kudu/127.12.155.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38487
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:38143,127.12.155.189:40991,127.12.155.188:46647
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:51:48.401470 2805 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 1
I20260807 19:51:48.402731 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.402272 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45516)
0807 19:51:48.402474 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.402578 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
I20260807 19:51:48.403735 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.403367 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45522)
0807 19:51:48.403553 (+ 186us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.403619 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:51:48.403947 2805 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.472189 2805 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 2
I20260807 19:51:48.473448 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.472975 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45524)
0807 19:51:48.473190 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.473290 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 19:51:48.474531 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.474183 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45534)
0807 19:51:48.474325 (+ 142us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.474403 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":45}
W20260807 19:51:48.474757 2805 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.481660 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } attempt: 5
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:51:48.496276 2810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.482625 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59692 (local address 127.12.155.189:40991)
0807 19:51:48.482831 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.482838 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.482873 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:51:48.482942 (+ 69us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.482947 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.483064 (+ 117us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.483187 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.484157 (+ 970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.484985 (+ 828us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.486652 (+ 1667us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.487116 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.487255 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.490752 (+ 3497us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.490757 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.490761 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.490795 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.493502 (+ 2707us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.494276 (+ 774us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.494282 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.494286 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.494417 (+ 131us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.494831 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.494836 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.494840 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.495135 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.495293 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.495717 (+ 424us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.495930 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
I20260807 19:51:48.496277 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.482396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59692)
0807 19:51:48.482603 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.482629 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.482803 (+ 174us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.483245 (+ 442us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.483251 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.483770 (+ 519us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.483974 (+ 204us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.483985 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.485219 (+ 1234us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.485225 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.486476 (+ 1251us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.486490 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.487298 (+ 808us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.487304 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.487482 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.488189 (+ 707us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.488207 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.490536 (+ 2329us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.493685 (+ 3149us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.493695 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.493700 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.494147 (+ 447us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.494537 (+ 390us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.494542 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.494546 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.494708 (+ 162us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.495260 (+ 552us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.495266 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.495426 (+ 160us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.495604 (+ 178us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.495897 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 19:51:48.497646 2682 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:51:48.498850 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.498416 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45550)
0807 19:51:48.498634 (+ 218us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.498721 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 19:51:48.499858 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.499530 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45554)
0807 19:51:48.499686 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.499765 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 19:51:48.500093 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.551331 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 1
I20260807 19:51:48.552755 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.552084 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45564)
0807 19:51:48.552367 (+ 283us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.552510 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 19:51:48.554193 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.553693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45578)
0807 19:51:48.553876 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.554003 (+ 127us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
W20260807 19:51:48.554445 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.565980 2805 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 3
I20260807 19:51:48.567137 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.566671 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45588)
0807 19:51:48.566865 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.566958 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":72}
I20260807 19:51:48.568240 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.567803 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45598)
0807 19:51:48.568042 (+ 239us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.568127 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":127}
W20260807 19:51:48.568539 2805 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.622687 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 2
I20260807 19:51:48.624060 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.623415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45600)
0807 19:51:48.623700 (+ 285us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.623823 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":81}
I20260807 19:51:48.625156 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.624744 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45606)
0807 19:51:48.624914 (+ 170us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.625012 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:51:48.625380 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.711773 2805 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 4
I20260807 19:51:48.712980 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.712473 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45608)
0807 19:51:48.712703 (+ 230us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.712792 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 19:51:48.713971 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.713648 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45624)
0807 19:51:48.713806 (+ 158us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.713872 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 19:51:48.714215 2805 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
W20260807 19:51:48.715994 2813 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:48.716276 2813 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:48.716441 2813 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:48.723629 2813 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:48.723749 2813 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:48.723853 2813 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:48.723949 2813 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:48.724032 2813 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:48.731606 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 3
I20260807 19:51:48.732729 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.732226 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45626)
0807 19:51:48.732432 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.732534 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 19:51:48.733857 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.733452 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45636)
0807 19:51:48.733652 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.733742 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
W20260807 19:51:48.734087 2682 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:46647: Network error: Client connection negotiation failed: client connection to 127.12.155.188:46647: connect: Connection refused (error 111)
I20260807 19:51:48.734720 2813 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38487
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:38143,127.12.155.189:40991,127.12.155.188:46647
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab
--principal=kudu/127.12.155.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:46647
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.155.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:48.736145 2813 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:48.737445 2813 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:48.749739 2820 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:48.749784 2821 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:48.750550 2824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:48.751019 2813 server_base.cc:1034] running on GCE node
I20260807 19:51:48.751776 2813 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:48.753157 2813 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:48.754354 2813 hybrid_clock.cc:648] HybridClock initialized: now 1786132308754317 us; error 25 us; skew 500 ppm
I20260807 19:51:48.754758 2813 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:48.757953 2813 init.cc:377] Logged in from keytab as kudu/127.12.155.188@KRBTEST.COM (short username kudu)
I20260807 19:51:48.759514 2813 webserver.cc:460] Webserver started at http://127.12.155.188:37191/ using document root <none> and password file <none>
I20260807 19:51:48.760218 2813 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:48.760366 2813 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:48.760686 2813 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:48.763736 2813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data/instance:
uuid: "e9f0fb0123cb4004b596d9c93d280c09"
format_stamp: "Formatted at 2026-08-07 19:51:48 on dist-test-slave-2p8l"
server_key: "039a4bdc2fac7c952b8b16d5b296d454"
server_key_iv: "dba0b0b8218d8b4326610fe51709409d"
server_key_version: "encryptionkey@0"
I20260807 19:51:48.764568 2813 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal/instance:
uuid: "e9f0fb0123cb4004b596d9c93d280c09"
format_stamp: "Formatted at 2026-08-07 19:51:48 on dist-test-slave-2p8l"
server_key: "039a4bdc2fac7c952b8b16d5b296d454"
server_key_iv: "dba0b0b8218d8b4326610fe51709409d"
server_key_version: "encryptionkey@0"
I20260807 19:51:48.769956 2813 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:51:48.773568 2833 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:48.775095 2813 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:48.775285 2813 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal
uuid: "e9f0fb0123cb4004b596d9c93d280c09"
format_stamp: "Formatted at 2026-08-07 19:51:48 on dist-test-slave-2p8l"
server_key: "039a4bdc2fac7c952b8b16d5b296d454"
server_key_iv: "dba0b0b8218d8b4326610fe51709409d"
server_key_version: "encryptionkey@0"
I20260807 19:51:48.775535 2813 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:48.798727 2813 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:48.803303 2813 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:48.803689 2813 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:48.822849 2813 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.188:46647
I20260807 19:51:48.822891 2918 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.188:46647 every 8 connection(s)
I20260807 19:51:48.824203 2813 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
I20260807 19:51:48.825333 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 2813
I20260807 19:51:48.825538 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACert.1786132073392555-12910-0/minicluster-data/master-2/wal/instance
I20260807 19:51:48.826176 12910 external_mini_cluster.cc:1428] Setting key 29b061f6058656bf01a13cff98bcfe7e
I20260807 19:51:48.828927 2919 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:48.837512 2919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:48.851266 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.828208 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45638 (local address 127.12.155.188:46647)
0807 19:51:48.829203 (+ 995us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.829217 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.829264 (+ 47us) server_negotiation.cc:407] Connection header received
0807 19:51:48.831015 (+ 1751us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.831036 (+ 21us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.831410 (+ 374us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.831752 (+ 342us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.833634 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.835169 (+ 1535us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.837209 (+ 2040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.837899 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.838046 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.843105 (+ 5059us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.843119 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.843138 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.843183 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.846887 (+ 3704us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.847689 (+ 802us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.847700 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.847711 (+ 11us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.847931 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.848320 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.848330 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.848334 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.849053 (+ 719us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.849292 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.849824 (+ 532us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.850237 (+ 413us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":646,"thread_start_us":421,"threads_started":1}
I20260807 19:51:48.856812 2926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.840440 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38143 (local address 127.0.0.1:47728)
0807 19:51:48.841216 (+ 776us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.841273 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.841430 (+ 157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.842296 (+ 866us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.842301 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.842851 (+ 550us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.843282 (+ 431us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.843295 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.844382 (+ 1087us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.844387 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.846187 (+ 1800us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.846203 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.847032 (+ 829us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.847038 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.847180 (+ 142us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.847800 (+ 620us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.847826 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.850461 (+ 2635us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.853703 (+ 3242us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.853715 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.853721 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.854338 (+ 617us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.854864 (+ 526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.854868 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.854871 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.854996 (+ 125us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.855643 (+ 647us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.855652 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.855903 (+ 251us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.856126 (+ 223us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.856435 (+ 309us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":331,"threads_started":1}
I20260807 19:51:48.856829 2927 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.840530 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47728 (local address 127.12.155.190:38143)
0807 19:51:48.841880 (+ 1350us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.841886 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.841906 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:51:48.841969 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.841976 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.842100 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.842231 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.843456 (+ 1225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.844222 (+ 766us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.846327 (+ 2105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.846848 (+ 521us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.846951 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.850654 (+ 3703us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.850659 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.850663 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.850693 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.853567 (+ 2874us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.854535 (+ 968us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.854542 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.854548 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.854744 (+ 196us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.855119 (+ 375us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.855123 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.855127 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.855502 (+ 375us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.855613 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.856230 (+ 617us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.856391 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1231,"thread_start_us":1126,"threads_started":1}
I20260807 19:51:48.858433 2919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:51:48.870873 2928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.854211 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47730 (local address 127.12.155.190:38143)
0807 19:51:48.854886 (+ 675us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.854894 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.854917 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:51:48.854951 (+ 34us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.854954 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.855004 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.855132 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.856618 (+ 1486us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.857756 (+ 1138us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.859247 (+ 1491us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.859911 (+ 664us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.860042 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.864616 (+ 4574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.864628 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.864632 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.864664 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.868038 (+ 3374us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.868719 (+ 681us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.868726 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.868733 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.868889 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.869278 (+ 389us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.869283 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.869286 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.869639 (+ 353us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.869897 (+ 258us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.870222 (+ 325us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.870432 (+ 210us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":513,"thread_start_us":291,"threads_started":1}
I20260807 19:51:48.871981 2810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.859267 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59698 (local address 127.12.155.189:40991)
0807 19:51:48.859467 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.859476 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.859494 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:51:48.859554 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.859559 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.859637 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.859752 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.860399 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.861264 (+ 865us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.862512 (+ 1248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.863088 (+ 576us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.863243 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.866174 (+ 2931us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.866180 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.866183 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.866215 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.869336 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.869963 (+ 627us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.869968 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.869972 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.870192 (+ 220us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.870577 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.870584 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.870587 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.870848 (+ 261us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.871004 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.871405 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.871618 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:51:48.872282 2926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.859072 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40991 (local address 127.0.0.1:59698)
0807 19:51:48.859312 (+ 240us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.859329 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.859428 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.859776 (+ 348us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.859779 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.860094 (+ 315us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.860236 (+ 142us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.860243 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.861412 (+ 1169us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.861420 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.862368 (+ 948us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.862379 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.863268 (+ 889us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.863273 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.863438 (+ 165us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.864014 (+ 576us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.864030 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.865946 (+ 1916us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.869467 (+ 3521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.869471 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.869473 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.869823 (+ 350us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.870309 (+ 486us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.870315 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.870318 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.870462 (+ 144us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.870968 (+ 506us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.870973 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.871139 (+ 166us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.871309 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.871579 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":143}
I20260807 19:51:48.873453 2919 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:51:48.887060 2926 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.874331 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45640)
0807 19:51:48.874487 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.874504 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.874593 (+ 89us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.875017 (+ 424us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.875019 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.875360 (+ 341us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.875489 (+ 129us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.875496 (+ 7us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.876482 (+ 986us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.876490 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.877581 (+ 1091us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.877595 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.878368 (+ 773us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.878374 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.878552 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.879101 (+ 549us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.879117 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.881346 (+ 2229us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.884486 (+ 3140us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.884492 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.884497 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.884938 (+ 441us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.885322 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.885327 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.885331 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.885499 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.886118 (+ 619us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.886129 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.886267 (+ 138us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.886423 (+ 156us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.886739 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 19:51:48.887549 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.874550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45640 (local address 127.12.155.188:46647)
0807 19:51:48.874748 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.874753 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.874769 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:51:48.874813 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.874819 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.874892 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.874990 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.875636 (+ 646us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.876345 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.877734 (+ 1389us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.878209 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.878348 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.881521 (+ 3173us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.881527 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.881532 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.881569 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.884341 (+ 2772us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.885058 (+ 717us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.885062 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.885064 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.885194 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.885608 (+ 414us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.885611 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.885613 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.885975 (+ 362us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.886157 (+ 182us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.886541 (+ 384us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.886947 (+ 406us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":152,"server-negotiator.queue_time_us":74}
I20260807 19:51:48.888641 2810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.872542 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59702 (local address 127.12.155.189:40991)
0807 19:51:48.872770 (+ 228us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.872775 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.872860 (+ 85us) server_negotiation.cc:407] Connection header received
0807 19:51:48.873026 (+ 166us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.873031 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.873102 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.873238 (+ 136us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.874774 (+ 1536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.875618 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.877070 (+ 1452us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.877467 (+ 397us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.877559 (+ 92us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.882491 (+ 4932us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.882498 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.882503 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.882542 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.885639 (+ 3097us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.886431 (+ 792us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.886436 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.886439 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.886601 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.887085 (+ 484us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.887092 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.887097 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.887392 (+ 295us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.887596 (+ 204us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.888042 (+ 446us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.888282 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":122}
I20260807 19:51:48.893323 2919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: Bootstrap starting.
I20260807 19:51:48.893558 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:51:48.896559 2919 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:48.897740 2919 log.cc:824] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:48.901268 2919 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: No bootstrap required, opened a new log
I20260807 19:51:48.911279 2682 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 4
I20260807 19:51:48.913220 2919 raft_consensus.cc:348] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:48.913827 2919 raft_consensus.cc:374] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:48.914031 2919 raft_consensus.cc:729] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9f0fb0123cb4004b596d9c93d280c09, State: Initialized, Role: FOLLOWER
I20260807 19:51:48.915006 2919 consensus_queue.cc:260] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:48.919150 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.898956 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45646 (local address 127.12.155.188:46647)
0807 19:51:48.899431 (+ 475us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.899439 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.900048 (+ 609us) server_negotiation.cc:407] Connection header received
0807 19:51:48.900107 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.900112 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.900185 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.900281 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.902695 (+ 2414us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.903849 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.906093 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.906754 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.906882 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.910800 (+ 3918us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.910807 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.910812 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.910855 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.914593 (+ 3738us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.915585 (+ 992us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.915593 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.915598 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.915803 (+ 205us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.916386 (+ 583us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.916393 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.916399 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.916938 (+ 539us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.917269 (+ 331us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.918264 (+ 995us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.918577 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":317}
I20260807 19:51:48.922264 2946 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:48.924861 2946 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:48.924738 2919 sys_catalog.cc:564] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:48.927281 2810 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.899752 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59718 (local address 127.12.155.189:40991)
0807 19:51:48.899925 (+ 173us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.899931 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.906749 (+ 6818us) server_negotiation.cc:407] Connection header received
0807 19:51:48.907160 (+ 411us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.907166 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.907260 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.907326 (+ 66us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.909816 (+ 2490us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.911042 (+ 1226us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.913004 (+ 1962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.913791 (+ 787us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.913913 (+ 122us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.918272 (+ 4359us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.918282 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.918290 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.918352 (+ 62us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.923541 (+ 5189us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.924680 (+ 1139us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.924688 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.924694 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.924887 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.925392 (+ 505us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.925398 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.925400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.925806 (+ 406us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.926030 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.926650 (+ 620us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.926892 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:51:48.928026 2928 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.898444 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47738 (local address 127.12.155.190:38143)
0807 19:51:48.898678 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.898686 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.899962 (+ 1276us) server_negotiation.cc:407] Connection header received
0807 19:51:48.900157 (+ 195us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.900163 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.900251 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.900370 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.903346 (+ 2976us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.904725 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.907148 (+ 2423us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.907813 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.907917 (+ 104us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.919769 (+ 11852us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.919778 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.919785 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.919829 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.924434 (+ 4605us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.925532 (+ 1098us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.925538 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.925541 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.925693 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.926185 (+ 492us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.926194 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.926197 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.926591 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.926869 (+ 278us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.927433 (+ 564us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.927667 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 19:51:48 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132307, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:51:48.941594 2686 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.912237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45648)
0807 19:51:48.912576 (+ 339us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:48.912594 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:48.913334 (+ 740us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:48.920158 (+ 6824us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:48.920166 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:48.920845 (+ 679us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:48.921152 (+ 307us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.921169 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.926081 (+ 4912us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.926087 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.928097 (+ 2010us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:48.928118 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.929543 (+ 1425us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.929552 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:48.929855 (+ 303us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.930616 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:48.930657 (+ 41us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:48.933651 (+ 2994us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:48.938556 (+ 4905us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.938563 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.938568 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.939121 (+ 553us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.939642 (+ 521us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:48.939647 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:48.939650 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:48.939825 (+ 175us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:48.940557 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:48.940562 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:48.940746 (+ 184us) client_negotiation.cc:769] Sending connection context
0807 19:51:48.940900 (+ 154us) client_negotiation.cc:240] Negotiation successful
0807 19:51:48.941198 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":210}
I20260807 19:51:48.941597 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:48.913006 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45648 (local address 127.12.155.188:46647)
0807 19:51:48.919724 (+ 6718us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:48.919732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:48.919756 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:51:48.919818 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:48.919826 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:48.919937 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:48.921593 (+ 1656us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:48.922704 (+ 1111us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.925892 (+ 3188us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.928359 (+ 2467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:48.929321 (+ 962us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:48.930275 (+ 954us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:48.933843 (+ 3568us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:48.933850 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:48.933855 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:48.933894 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:48.938389 (+ 4495us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.939310 (+ 921us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.939314 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.939318 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.939476 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:48.939988 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:48.939993 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:48.939996 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:48.940433 (+ 437us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:48.940573 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:48.940990 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 19:51:48.941221 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6569,"thread_start_us":16374,"threads_started":1}
I20260807 19:51:48.947618 2682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: Bootstrap starting.
W20260807 19:51:48.952904 2967 catalog_manager.cc:1558] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:51:48.953131 2967 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:51:48.954003 2682 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:48.955395 2682 log.cc:824] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:48.958886 2682 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: No bootstrap required, opened a new log
I20260807 19:51:48.950451 2813 master_runner.cc:186] Error getting master registration for 127.12.155.190:38143: OK, instance_id { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" instance_seqno: 1786132307764397 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:51:48.961117 2813 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:51:48.969967 2682 raft_consensus.cc:348] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:48.970417 2682 raft_consensus.cc:374] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:48.970544 2682 raft_consensus.cc:729] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d5edc15354f74ee4a851e8f868933738, State: Initialized, Role: FOLLOWER
I20260807 19:51:48.971228 2682 consensus_queue.cc:260] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:48.972134 2970 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:48.972471 2970 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:48.973611 2682 sys_catalog.cc:564] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: configured and running, proceeding with master startup.
W20260807 19:51:48.985389 2986 catalog_manager.cc:1558] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:51:48.985590 2986 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:51:48.983736 2578 master_runner.cc:186] Error getting master registration for 127.12.155.189:40991: OK, instance_id { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" instance_seqno: 1786132308285369 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:51:48.996910 2578 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
W20260807 19:51:49.003114 2614 tablet.cc:2369] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:51:49.013474 2805 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } attempt: 5
Aug 07 19:51:49 dist-test-slave-2p8l krb5kdc[2555](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132308, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:51:49.031484 2808 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:49.014190 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:46647 (local address 127.0.0.1:45664)
0807 19:51:49.014375 (+ 185us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:49.014397 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:49.014519 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:49.014916 (+ 397us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:49.014922 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:49.015477 (+ 555us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:49.015711 (+ 234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:49.015724 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:49.017213 (+ 1489us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:49.017243 (+ 30us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:49.018699 (+ 1456us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:49.018716 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:49.020276 (+ 1560us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:49.020284 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:49.020538 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:49.021262 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:49.021287 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:49.024197 (+ 2910us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:49.028551 (+ 4354us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:49.028558 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:49.028562 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:49.029081 (+ 519us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:49.029528 (+ 447us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:49.029533 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:49.029537 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:49.029762 (+ 225us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:49.030430 (+ 668us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:49.030436 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:49.030598 (+ 162us) client_negotiation.cc:769] Sending connection context
0807 19:51:49.030778 (+ 180us) client_negotiation.cc:240] Negotiation successful
0807 19:51:49.031076 (+ 298us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:51:49.031970 2924 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:49.014301 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45664 (local address 127.12.155.188:46647)
0807 19:51:49.014500 (+ 199us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:49.014505 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:49.014526 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:51:49.014663 (+ 137us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:49.014668 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:49.014746 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:49.014849 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:49.015894 (+ 1045us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:49.017062 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:49.019176 (+ 2114us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:49.019917 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:49.020053 (+ 136us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:49.024404 (+ 4351us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:49.024411 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:49.024416 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:49.024469 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:49.028405 (+ 3936us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:49.029225 (+ 820us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:49.029230 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:49.029234 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:49.029404 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:49.029895 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:49.029900 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:49.029904 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:49.030290 (+ 386us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:49.030452 (+ 162us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:49.030915 (+ 463us) server_negotiation.cc:299] Negotiation successful
0807 19:51:49.031176 (+ 261us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:51:49.037946 2805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: Bootstrap starting.
I20260807 19:51:49.042296 2805 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:49.043635 2805 log.cc:824] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:49.046948 2805 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: No bootstrap required, opened a new log
W20260807 19:51:49.057559 2847 tablet.cc:2369] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:51:49.061749 2805 raft_consensus.cc:348] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:49.062196 2805 raft_consensus.cc:374] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:49.062325 2805 raft_consensus.cc:729] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 78e0783922f04b9ba8ae639d3a8689e0, State: Initialized, Role: FOLLOWER
I20260807 19:51:49.063016 2805 consensus_queue.cc:260] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:49.064038 2991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.064532 2991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:49.065425 2805 sys_catalog.cc:564] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:49.067170 2946 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:51:49.067505 2946 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:49.069252 2946 leader_election.cc:288] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers d5edc15354f74ee4a851e8f868933738 (127.12.155.190:38143), 78e0783922f04b9ba8ae639d3a8689e0 (127.12.155.189:40991)
I20260807 19:51:49.070490 2763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9f0fb0123cb4004b596d9c93d280c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e0783922f04b9ba8ae639d3a8689e0" is_pre_election: true
I20260807 19:51:49.071067 2763 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9f0fb0123cb4004b596d9c93d280c09 in term 0.
I20260807 19:51:49.071811 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9f0fb0123cb4004b596d9c93d280c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5edc15354f74ee4a851e8f868933738" is_pre_election: true
I20260807 19:51:49.072381 2641 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e9f0fb0123cb4004b596d9c93d280c09 in term 0.
I20260807 19:51:49.076682 2838 leader_election.cc:302] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5edc15354f74ee4a851e8f868933738, e9f0fb0123cb4004b596d9c93d280c09; no voters:
I20260807 19:51:49.077440 2946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:51:49.077594 2946 raft_consensus.cc:482] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:51:49.077705 2946 raft_consensus.cc:3037] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:49.081085 2946 raft_consensus.cc:504] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:49.081732 2946 leader_election.cc:288] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [CANDIDATE]: Term 1 election: Requested vote from peers d5edc15354f74ee4a851e8f868933738 (127.12.155.190:38143), 78e0783922f04b9ba8ae639d3a8689e0 (127.12.155.189:40991)
I20260807 19:51:49.083282 2763 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9f0fb0123cb4004b596d9c93d280c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "78e0783922f04b9ba8ae639d3a8689e0"
I20260807 19:51:49.083489 2763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:49.086521 2641 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "e9f0fb0123cb4004b596d9c93d280c09" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "d5edc15354f74ee4a851e8f868933738"
I20260807 19:51:49.086743 2641 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:49.090126 2641 raft_consensus.cc:2454] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9f0fb0123cb4004b596d9c93d280c09 in term 1.
I20260807 19:51:49.090660 2838 leader_election.cc:302] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: d5edc15354f74ee4a851e8f868933738, e9f0fb0123cb4004b596d9c93d280c09; no voters:
I20260807 19:51:49.091692 2763 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e9f0fb0123cb4004b596d9c93d280c09 in term 1.
I20260807 19:51:49.091938 2946 raft_consensus.cc:2781] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:51:49.103003 2946 raft_consensus.cc:686] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [term 1 LEADER]: Becoming Leader. State: Replica: e9f0fb0123cb4004b596d9c93d280c09, State: Running, Role: LEADER
I20260807 19:51:49.103979 2946 consensus_queue.cc:237] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } }
I20260807 19:51:49.116335 3009 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9f0fb0123cb4004b596d9c93d280c09. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.116707 3009 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:49.118268 3013 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:51:49.120517 3013 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:51:49.121070 3012 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:51:49.139295 2641 raft_consensus.cc:1261] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [term 1 FOLLOWER]: Refusing update from remote peer e9f0fb0123cb4004b596d9c93d280c09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:51:49.139295 2763 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [term 1 FOLLOWER]: Refusing update from remote peer e9f0fb0123cb4004b596d9c93d280c09: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:51:49.140336 2946 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:51:49.140733 3009 consensus_queue.cc:1035] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [LEADER]: Connected to new peer: Peer: permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:51:49.166450 2970 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9f0fb0123cb4004b596d9c93d280c09. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.166533 2991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e9f0fb0123cb4004b596d9c93d280c09. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.166800 2970 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:49.166824 2991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:49.169900 3014 mvcc.cc:205] Tried to move back new op lower bound from 7315997938224349184 to 7315997938096316416. Current Snapshot: MvccSnapshot[applied={T|T < 7315997938224349184}]
I20260807 19:51:49.176419 3016 mvcc.cc:205] Tried to move back new op lower bound from 7315997938224349184 to 7315997938096316416. Current Snapshot: MvccSnapshot[applied={T|T < 7315997938224349184}]
I20260807 19:51:49.179317 2991 sys_catalog.cc:455] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.179688 2991 sys_catalog.cc:458] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:49.184270 3009 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.184602 3009 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:49.185061 3009 sys_catalog.cc:455] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.185391 3009 sys_catalog.cc:458] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:49.190253 2970 sys_catalog.cc:455] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "e9f0fb0123cb4004b596d9c93d280c09" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "d5edc15354f74ee4a851e8f868933738" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38143 } } peers { permanent_uuid: "78e0783922f04b9ba8ae639d3a8689e0" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40991 } } peers { permanent_uuid: "e9f0fb0123cb4004b596d9c93d280c09" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 46647 } } }
I20260807 19:51:49.190514 2970 sys_catalog.cc:458] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:51:49.190944 3013 catalog_manager.cc:1347] Generated new cluster ID: 3523fb70eb844e3dafaec88292c4c4e4
I20260807 19:51:49.191051 3013 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:51:49.210265 3013 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:51:49.214493 3013 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:51:49.227569 3013 catalog_manager.cc:5868] T 00000000000000000000000000000000 P e9f0fb0123cb4004b596d9c93d280c09: Generated new TSK 0
I20260807 19:51:49.228767 3013 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:51:49.987728 2986 catalog_manager.cc:1259] Loaded cluster ID: 3523fb70eb844e3dafaec88292c4c4e4
I20260807 19:51:49.987914 2986 catalog_manager.cc:1552] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: loading cluster ID for follower catalog manager: success
I20260807 19:51:49.990427 2986 catalog_manager.cc:1574] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: acquiring CA information for follower catalog manager: success
I20260807 19:51:49.992162 2986 catalog_manager.cc:1602] T 00000000000000000000000000000000 P d5edc15354f74ee4a851e8f868933738: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:51:50.125927 3012 catalog_manager.cc:1259] Loaded cluster ID: 3523fb70eb844e3dafaec88292c4c4e4
I20260807 19:51:50.126092 3012 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: loading cluster ID for follower catalog manager: success
I20260807 19:51:50.128772 3012 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: acquiring CA information for follower catalog manager: success
I20260807 19:51:50.130662 3012 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 78e0783922f04b9ba8ae639d3a8689e0: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:51:50.322816 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 2578
I20260807 19:51:50.324247 2673 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:50.436959 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 2578
I20260807 19:51:50.474864 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 2695
I20260807 19:51:50.476052 2795 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:50.589763 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 2695
I20260807 19:51:50.617262 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 2813
I20260807 19:51:50.618551 2914 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:50.730424 3040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:50.729505 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:38143 (local address 127.0.0.1:47752)
0807 19:51:50.730083 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:50.730237 (+ 154us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:38143: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":410,"thread_start_us":313,"threads_started":1}
I20260807 19:51:50.730407 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 2813
2026-08-07T19:51:50Z chronyd exiting
[ OK ] SecurityITest.IPKICACert (5045 ms)
[ RUN ] SecurityITest.IPKICACertWebServerEndPoints
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:51:50 dist-test-slave-2p8l krb5kdc[3045](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:51:50 dist-test-slave-2p8l krb5kdc[3045](info): set up 2 sockets
Aug 07 19:51:50 dist-test-slave-2p8l krb5kdc[3045](info): commencing operation
krb5kdc: starting...
W20260807 19:51:52.084223 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.303s user 0.000s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:51:52 dist-test-slave-2p8l krb5kdc[3045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:51:52Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:51:52Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:51:52.357367 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38225
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:44267
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:38225
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:52.691489 3067 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:52.691789 3067 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:52.691977 3067 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:52.699805 3067 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:52.699951 3067 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:52.700066 3067 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:52.700174 3067 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:52.700260 3067 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:52.710386 3067 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44267
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:38225
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:38225
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:52.711728 3067 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:52.713079 3067 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:52.725723 3077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:52.725749 3073 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:52.725807 3072 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:52.726600 3067 server_base.cc:1034] running on GCE node
I20260807 19:51:52.727458 3067 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:52.728892 3067 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:52.730159 3067 hybrid_clock.cc:648] HybridClock initialized: now 1786132312730126 us; error 67 us; skew 500 ppm
I20260807 19:51:52.730525 3067 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:52 dist-test-slave-2p8l krb5kdc[3045](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132312, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:52.740455 3067 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:51:52.742182 3067 webserver.cc:460] Webserver started at http://127.12.155.190:44031/ using document root <none> and password file <none>
I20260807 19:51:52.742942 3067 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:52.743098 3067 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:52.743436 3067 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:52.746735 3067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "40aabcd06fa744aca9330a1a959fa032"
format_stamp: "Formatted at 2026-08-07 19:51:52 on dist-test-slave-2p8l"
server_key: "96f4a12a79c670219ce13d8a950e0c9f"
server_key_iv: "a890e2aa5e49287237818589b467e56b"
server_key_version: "encryptionkey@0"
I20260807 19:51:52.747525 3067 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "40aabcd06fa744aca9330a1a959fa032"
format_stamp: "Formatted at 2026-08-07 19:51:52 on dist-test-slave-2p8l"
server_key: "96f4a12a79c670219ce13d8a950e0c9f"
server_key_iv: "a890e2aa5e49287237818589b467e56b"
server_key_version: "encryptionkey@0"
I20260807 19:51:52.753221 3067 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:51:52.757862 3088 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:52.759310 3067 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:52.759624 3067 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "40aabcd06fa744aca9330a1a959fa032"
format_stamp: "Formatted at 2026-08-07 19:51:52 on dist-test-slave-2p8l"
server_key: "96f4a12a79c670219ce13d8a950e0c9f"
server_key_iv: "a890e2aa5e49287237818589b467e56b"
server_key_version: "encryptionkey@0"
I20260807 19:51:52.759853 3067 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:52.783793 3067 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:52.788854 3067 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:52.789197 3067 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:52.811730 3067 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:38225
I20260807 19:51:52.811771 3170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:38225 every 8 connection(s)
I20260807 19:51:52.813294 3067 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:51:52.813807 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 3067
I20260807 19:51:52.814107 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.IPKICACertWebServerEndPoints.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:51:52.815028 12910 external_mini_cluster.cc:1428] Setting key bcde8b0053ec5a0bb6cb17a0bf2426b5
I20260807 19:51:52.818178 3174 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:51:52 dist-test-slave-2p8l krb5kdc[3045](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132312, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:52.833534 3174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032: Bootstrap starting.
I20260807 19:51:52.837508 3174 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:52.838806 3174 log.cc:824] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:52.841684 3179 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:52.817180 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38522 (local address 127.12.155.190:38225)
0807 19:51:52.818104 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:52.818128 (+ 24us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:52.818178 (+ 50us) server_negotiation.cc:407] Connection header received
0807 19:51:52.819993 (+ 1815us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:52.820015 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:52.820386 (+ 371us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:52.820741 (+ 355us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:52.822954 (+ 2213us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:52.824499 (+ 1545us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:52.826853 (+ 2354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:52.827719 (+ 866us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:52.827877 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:52.833636 (+ 5759us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:52.833646 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:52.833672 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:52.833753 (+ 81us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:52.837100 (+ 3347us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:52.837994 (+ 894us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:52.838002 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:52.838008 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:52.838247 (+ 239us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:52.838681 (+ 434us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:52.838686 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:52.838690 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:52.839308 (+ 618us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:52.839702 (+ 394us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:52.840237 (+ 535us) server_negotiation.cc:299] Negotiation successful
0807 19:51:52.840708 (+ 471us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":653,"thread_start_us":398,"threads_started":1}
I20260807 19:51:52.842307 3174 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032: No bootstrap required, opened a new log
I20260807 19:51:52.847856 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:51:52.854223 3174 raft_consensus.cc:348] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40aabcd06fa744aca9330a1a959fa032" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38225 } }
I20260807 19:51:52.854730 3174 raft_consensus.cc:374] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:52.854831 3174 raft_consensus.cc:729] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 40aabcd06fa744aca9330a1a959fa032, State: Initialized, Role: FOLLOWER
I20260807 19:51:52.855557 3174 consensus_queue.cc:260] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40aabcd06fa744aca9330a1a959fa032" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38225 } }
I20260807 19:51:52.855777 3174 raft_consensus.cc:388] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:51:52.855934 3174 raft_consensus.cc:482] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:51:52.856124 3174 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:52.859239 3174 raft_consensus.cc:504] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40aabcd06fa744aca9330a1a959fa032" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38225 } }
I20260807 19:51:52.859910 3174 leader_election.cc:302] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 40aabcd06fa744aca9330a1a959fa032; no voters:
I20260807 19:51:52.860638 3174 leader_election.cc:288] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:51:52.860778 3181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:51:52.861512 3181 raft_consensus.cc:686] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [term 1 LEADER]: Becoming Leader. State: Replica: 40aabcd06fa744aca9330a1a959fa032, State: Running, Role: LEADER
I20260807 19:51:52.862402 3181 consensus_queue.cc:237] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40aabcd06fa744aca9330a1a959fa032" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38225 } }
I20260807 19:51:52.863260 3174 sys_catalog.cc:564] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:52.866027 3183 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "40aabcd06fa744aca9330a1a959fa032" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40aabcd06fa744aca9330a1a959fa032" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38225 } } }
I20260807 19:51:52.866569 3185 sys_catalog.cc:455] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 40aabcd06fa744aca9330a1a959fa032. Latest consensus state: current_term: 1 leader_uuid: "40aabcd06fa744aca9330a1a959fa032" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "40aabcd06fa744aca9330a1a959fa032" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 38225 } } }
I20260807 19:51:52.866828 3183 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:52.866955 3185 sys_catalog.cc:458] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032 [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:52.875077 3193 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:51:52.880739 3193 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:51:52.890372 3193 catalog_manager.cc:1347] Generated new cluster ID: c4a9647a9898434b97b1fad5ee9715d0
I20260807 19:51:52.890511 3193 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:51:52.918984 3193 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:51:52.921013 3193 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:51:52.928579 3193 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 40aabcd06fa744aca9330a1a959fa032: Generated new TSK 0
I20260807 19:51:52.929443 3193 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:51:52.962767 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 3067
I20260807 19:51:52.964219 3166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:53.063092 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 3067
2026-08-07T19:51:53Z chronyd exiting
[ OK ] SecurityITest.IPKICACertWebServerEndPoints (2331 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedIPKICert
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:51:53 dist-test-slave-2p8l krb5kdc[3214](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:51:53 dist-test-slave-2p8l krb5kdc[3214](info): set up 2 sockets
Aug 07 19:51:53 dist-test-slave-2p8l krb5kdc[3214](info): commencing operation
krb5kdc: starting...
W20260807 19:51:54.419142 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.307s user 0.001s sys 0.035s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:51:54 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:51:54Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:51:54Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:51:54.709440 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45949
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:45949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:55.059634 3228 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:55.059996 3228 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:55.060153 3228 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:55.067866 3228 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:55.068023 3228 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:55.068131 3228 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:55.068238 3228 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:55.068326 3228 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:55.078693 3228 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:45949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:55.080109 3228 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:55.081517 3228 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:55.093818 3242 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:55.093946 3238 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:55.093930 3240 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:55.094825 3228 server_base.cc:1034] running on GCE node
I20260807 19:51:55.095618 3228 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:55.097152 3228 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:55.098387 3228 hybrid_clock.cc:648] HybridClock initialized: now 1786132315098345 us; error 53 us; skew 500 ppm
I20260807 19:51:55.098752 3228 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:55 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:55.102028 3228 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:51:55.103653 3228 webserver.cc:460] Webserver started at http://127.12.155.190:46173/ using document root <none> and password file <none>
I20260807 19:51:55.104341 3228 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:55.104511 3228 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:55.104827 3228 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:55.107914 3228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "1cbfe5ac362142b188d5e2bd59705f1a"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b69c61f39f661807a43ba2ae5bb4da69"
server_key_iv: "4dd13a51bb054ed21cc1901e48cf6dc9"
server_key_version: "encryptionkey@0"
I20260807 19:51:55.108703 3228 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "1cbfe5ac362142b188d5e2bd59705f1a"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b69c61f39f661807a43ba2ae5bb4da69"
server_key_iv: "4dd13a51bb054ed21cc1901e48cf6dc9"
server_key_version: "encryptionkey@0"
I20260807 19:51:55.114177 3228 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 19:51:55.117786 3257 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:55.119186 3228 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:55.119386 3228 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "1cbfe5ac362142b188d5e2bd59705f1a"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b69c61f39f661807a43ba2ae5bb4da69"
server_key_iv: "4dd13a51bb054ed21cc1901e48cf6dc9"
server_key_version: "encryptionkey@0"
I20260807 19:51:55.119597 3228 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:55.147799 3228 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:55.152247 3228 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:55.152572 3228 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:55.172645 3228 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:45949
I20260807 19:51:55.172698 3342 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:45949 every 8 connection(s)
I20260807 19:51:55.174165 3228 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:51:55.178037 3343 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:55.178299 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 3228
I20260807 19:51:55.178539 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:51:55.179243 12910 external_mini_cluster.cc:1428] Setting key 9cb64bd9b54c322d8e118884719ef043
I20260807 19:51:55.193131 3343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap starting.
Aug 07 19:51:55 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:55.196619 3343 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:55.197836 3343 log.cc:824] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:55.200980 3343 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: No bootstrap required, opened a new log
I20260807 19:51:55.204627 3347 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:55.181475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54510 (local address 127.12.155.190:45949)
0807 19:51:55.182313 (+ 838us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:55.182329 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:55.182379 (+ 50us) server_negotiation.cc:407] Connection header received
0807 19:51:55.185025 (+ 2646us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:55.185056 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:55.185570 (+ 514us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:55.186090 (+ 520us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:55.187478 (+ 1388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:55.189566 (+ 2088us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:55.191060 (+ 1494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:55.192107 (+ 1047us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:55.192299 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:55.196960 (+ 4661us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:55.196975 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:55.196990 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:55.197032 (+ 42us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:55.200298 (+ 3266us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:55.201043 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:55.201050 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:55.201055 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:55.201289 (+ 234us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:55.201726 (+ 437us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:55.201731 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:55.201735 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:55.202328 (+ 593us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:55.202691 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:55.203187 (+ 496us) server_negotiation.cc:299] Negotiation successful
0807 19:51:55.203605 (+ 418us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":600,"thread_start_us":340,"threads_started":1}
I20260807 19:51:55.209158 3343 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:55.209543 3343 raft_consensus.cc:374] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:55.209657 3343 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbfe5ac362142b188d5e2bd59705f1a, State: Initialized, Role: FOLLOWER
I20260807 19:51:55.210275 3343 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:55.210517 3343 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:51:55.210666 3343 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:51:55.210855 3343 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:55.213091 3343 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:55.213580 3343 leader_election.cc:302] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cbfe5ac362142b188d5e2bd59705f1a; no voters:
I20260807 19:51:55.214273 3343 leader_election.cc:288] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:51:55.214430 3354 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:51:55.215551 3354 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 LEADER]: Becoming Leader. State: Replica: 1cbfe5ac362142b188d5e2bd59705f1a, State: Running, Role: LEADER
I20260807 19:51:55.216102 3354 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:55.216672 3343 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:55.218834 3355 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } } }
I20260807 19:51:55.219242 3355 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:55.219909 3357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cbfe5ac362142b188d5e2bd59705f1a. Latest consensus state: current_term: 1 leader_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } } }
I20260807 19:51:55.220352 3357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:55.222182 3366 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:51:55.227671 3366 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:51:55.236274 3366 catalog_manager.cc:1347] Generated new cluster ID: 922ad8d3844346ae9e589cc0e1054d0a
I20260807 19:51:55.236408 3366 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:51:55.268842 3366 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:51:55.270988 3366 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:51:55.288385 3366 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Generated new TSK 0
I20260807 19:51:55.289250 3366 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:51:55.366914 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45949
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:55.710997 3384 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:55.711325 3384 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:55.711499 3384 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:55.719106 3384 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:55.719278 3384 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:55.719455 3384 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:51:55.730480 3384 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:55.731845 3384 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:55.733199 3384 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:55.747139 3398 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:55.747182 3395 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:55.747460 3392 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:55.748087 3384 server_base.cc:1034] running on GCE node
I20260807 19:51:55.748661 3384 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:55.749552 3384 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:55.750746 3384 hybrid_clock.cc:648] HybridClock initialized: now 1786132315750684 us; error 53 us; skew 500 ppm
I20260807 19:51:55.751027 3384 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:55 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:55.754230 3384 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:51:55.755681 3384 webserver.cc:460] Webserver started at http://127.12.155.129:34203/ using document root <none> and password file <none>
I20260807 19:51:55.756317 3384 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:55.756423 3384 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:55.756675 3384 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:55.759620 3384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "086e5dfe99fd45d8a0b36f361bd65625"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b24cf7cee836097dbdd23452a37c59cc"
server_key_iv: "5eb95d3538836bbd47a8ae21d875823b"
server_key_version: "encryptionkey@0"
I20260807 19:51:55.760378 3384 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "086e5dfe99fd45d8a0b36f361bd65625"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b24cf7cee836097dbdd23452a37c59cc"
server_key_iv: "5eb95d3538836bbd47a8ae21d875823b"
server_key_version: "encryptionkey@0"
I20260807 19:51:55.765604 3384 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:51:55.769057 3410 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:55.770429 3384 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 19:51:55.770566 3384 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "086e5dfe99fd45d8a0b36f361bd65625"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b24cf7cee836097dbdd23452a37c59cc"
server_key_iv: "5eb95d3538836bbd47a8ae21d875823b"
server_key_version: "encryptionkey@0"
I20260807 19:51:55.770725 3384 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:55.783530 3384 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:55.787686 3384 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:55.787995 3384 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:55.788977 3384 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:55.790381 3384 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:55.790457 3384 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:55.790582 3384 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:55.790647 3384 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:55.825543 3384 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34755
I20260807 19:51:55.825639 3585 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34755 every 8 connection(s)
I20260807 19:51:55.827059 3384 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:51:55.837064 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 3384
I20260807 19:51:55.837306 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:51:55.837988 12910 external_mini_cluster.cc:1428] Setting key 9866dde4c21c235797f81e78895673e6
Aug 07 19:51:55 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132315, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:55.848724 3590 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:55.829786 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:42919 (local address 127.12.155.190:45949)
0807 19:51:55.830291 (+ 505us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:55.830296 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:55.831220 (+ 924us) server_negotiation.cc:407] Connection header received
0807 19:51:55.833037 (+ 1817us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:55.833043 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:55.833139 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:55.833269 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:55.834871 (+ 1602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:55.835621 (+ 750us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:55.837224 (+ 1603us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:55.837670 (+ 446us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:55.837817 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:55.841674 (+ 3857us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:55.841681 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:55.841689 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:55.841736 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:55.845330 (+ 3594us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:55.846051 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:55.846091 (+ 40us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:55.846098 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:55.846268 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:55.846715 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:55.846723 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:55.846729 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:55.847132 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:55.847307 (+ 175us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:55.847981 (+ 674us) server_negotiation.cc:299] Negotiation successful
0807 19:51:55.848250 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":397,"thread_start_us":287,"threads_started":1}
I20260807 19:51:55.849355 3592 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:55.830309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:42919)
0807 19:51:55.831042 (+ 733us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:55.831088 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:55.832758 (+ 1670us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:55.833527 (+ 769us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:55.833535 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:55.834050 (+ 515us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:55.834695 (+ 645us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:55.834713 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:55.835790 (+ 1077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:55.835800 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:55.837041 (+ 1241us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:55.837053 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:55.837909 (+ 856us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:55.837918 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:55.838239 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:55.838956 (+ 717us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:55.838980 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:55.841446 (+ 2466us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:55.845483 (+ 4037us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:55.845490 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:55.845502 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:55.845916 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:55.846397 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:55.846400 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:55.846402 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:55.846582 (+ 180us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:55.847269 (+ 687us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:55.847274 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:55.847599 (+ 325us) client_negotiation.cc:769] Sending connection context
0807 19:51:55.847815 (+ 216us) client_negotiation.cc:240] Negotiation successful
0807 19:51:55.848218 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":502,"thread_start_us":298,"threads_started":1}
I20260807 19:51:55.851135 3586 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45949
I20260807 19:51:55.851488 3586 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:55.852286 3586 heartbeater.cc:511] Master 127.12.155.190:45949 requested a full tablet report, sending...
I20260807 19:51:55.854699 3285 ts_manager.cc:194] Registered new tserver with Master: 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755)
I20260807 19:51:55.856935 3285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:42919
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:51:55.901684 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45949
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:56.262312 3596 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:56.262650 3596 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:56.262827 3596 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:56.270352 3596 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:56.270505 3596 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:56.270675 3596 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:51:56.280484 3596 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:56.281806 3596 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:56.283232 3596 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:56.296892 3603 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:56.296929 3604 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:56.297109 3609 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:56.297865 3596 server_base.cc:1034] running on GCE node
I20260807 19:51:56.298527 3596 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:56.299460 3596 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:56.300686 3596 hybrid_clock.cc:648] HybridClock initialized: now 1786132316300649 us; error 51 us; skew 500 ppm
I20260807 19:51:56.301009 3596 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:56 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:56.304219 3596 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:51:56.305744 3596 webserver.cc:460] Webserver started at http://127.12.155.130:38911/ using document root <none> and password file <none>
I20260807 19:51:56.306507 3596 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:56.306659 3596 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:56.306969 3596 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:56.309839 3596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "75cedda503084c78ad35d495e7bf3608"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "3c1244a3bb1455f373d3a3c4a20cb030"
server_key_iv: "e637cf69d8132237808669e2c4f2c25a"
server_key_version: "encryptionkey@0"
I20260807 19:51:56.310756 3596 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "75cedda503084c78ad35d495e7bf3608"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "3c1244a3bb1455f373d3a3c4a20cb030"
server_key_iv: "e637cf69d8132237808669e2c4f2c25a"
server_key_version: "encryptionkey@0"
I20260807 19:51:56.315776 3596 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:51:56.319262 3619 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:56.320639 3596 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:51:56.320842 3596 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "75cedda503084c78ad35d495e7bf3608"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "3c1244a3bb1455f373d3a3c4a20cb030"
server_key_iv: "e637cf69d8132237808669e2c4f2c25a"
server_key_version: "encryptionkey@0"
I20260807 19:51:56.321051 3596 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:56.333068 3596 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:56.336956 3596 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:56.337256 3596 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:56.338400 3596 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:56.339807 3596 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:56.339883 3596 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:56.339967 3596 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:56.340013 3596 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:56.374292 3596 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34059
I20260807 19:51:56.374302 3792 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34059 every 8 connection(s)
I20260807 19:51:56.375627 3596 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:51:56.380518 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 3596
I20260807 19:51:56.380817 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:51:56.381342 12910 external_mini_cluster.cc:1428] Setting key 16386e89913e7fd959f989ee88269a1a
Aug 07 19:51:56 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:56.396896 3796 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:56.378295 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:56081 (local address 127.12.155.190:45949)
0807 19:51:56.378729 (+ 434us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:56.378733 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:56.379791 (+ 1058us) server_negotiation.cc:407] Connection header received
0807 19:51:56.381809 (+ 2018us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:56.381815 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:56.381914 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:56.382045 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:56.383863 (+ 1818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.384606 (+ 743us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.386223 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.386659 (+ 436us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.386798 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:56.390860 (+ 4062us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:56.390865 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:56.390869 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:56.390903 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:56.393657 (+ 2754us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:56.394516 (+ 859us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:56.394524 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:56.394532 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:56.394672 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:56.395137 (+ 465us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:56.395144 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:56.395152 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:56.395415 (+ 263us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:56.395599 (+ 184us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:56.396282 (+ 683us) server_negotiation.cc:299] Negotiation successful
0807 19:51:56.396505 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":326,"thread_start_us":208,"threads_started":1}
I20260807 19:51:56.397876 3798 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:56.378843 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:56081)
0807 19:51:56.379621 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:56.379660 (+ 39us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:56.381530 (+ 1870us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:56.382298 (+ 768us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:56.382306 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:56.383001 (+ 695us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:56.383658 (+ 657us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:56.383675 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.384772 (+ 1097us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.384776 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:56.386010 (+ 1234us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:56.386038 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.386904 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.386912 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:56.387186 (+ 274us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:56.387943 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:56.387965 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:56.390599 (+ 2634us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:56.393835 (+ 3236us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:56.393845 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:56.393861 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:56.394382 (+ 521us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:56.394801 (+ 419us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:56.394808 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:56.394817 (+ 9us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:56.395002 (+ 185us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:56.395552 (+ 550us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:56.395560 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:56.395902 (+ 342us) client_negotiation.cc:769] Sending connection context
0807 19:51:56.396177 (+ 275us) client_negotiation.cc:240] Negotiation successful
0807 19:51:56.396700 (+ 523us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":528,"thread_start_us":321,"threads_started":1}
I20260807 19:51:56.399446 3793 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45949
I20260807 19:51:56.399832 3793 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:56.400782 3793 heartbeater.cc:511] Master 127.12.155.190:45949 requested a full tablet report, sending...
I20260807 19:51:56.402732 3285 ts_manager.cc:194] Registered new tserver with Master: 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
I20260807 19:51:56.404179 3285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:56081
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:51:56.451598 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45949
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:56.801270 3803 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:56.801687 3803 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:56.801888 3803 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:56.810366 3803 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:56.810571 3803 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:56.810765 3803 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:51:56.822692 3803 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:56.824376 3803 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:56.826265 3803 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:56.841194 3810 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:56.841275 3813 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:56.841235 3816 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:56.842051 3803 server_base.cc:1034] running on GCE node
I20260807 19:51:56.842789 3803 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:56.843770 3803 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:56.845021 3803 hybrid_clock.cc:648] HybridClock initialized: now 1786132316844967 us; error 61 us; skew 500 ppm
I20260807 19:51:56.845362 3803 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:56 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:56.848831 3803 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:51:56.850519 3803 webserver.cc:460] Webserver started at http://127.12.155.131:46427/ using document root <none> and password file <none>
I20260807 19:51:56.851238 3803 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:56.851399 3803 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:56.851723 3803 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:51:56.854773 3803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "f6e4f01bb6d54776904626a400bad314"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "d9aaf5c04bd3d2519d3d45fc60d10cef"
server_key_iv: "e7b73111ac30b81f9b86422168b8e156"
server_key_version: "encryptionkey@0"
I20260807 19:51:56.855612 3803 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "f6e4f01bb6d54776904626a400bad314"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "d9aaf5c04bd3d2519d3d45fc60d10cef"
server_key_iv: "e7b73111ac30b81f9b86422168b8e156"
server_key_version: "encryptionkey@0"
I20260807 19:51:56.860083 3586 heartbeater.cc:503] Master 127.12.155.190:45949 was elected leader, sending a full tablet report...
I20260807 19:51:56.861213 3803 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:51:56.865012 3828 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:56.866465 3803 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:56.866684 3803 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "f6e4f01bb6d54776904626a400bad314"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "d9aaf5c04bd3d2519d3d45fc60d10cef"
server_key_iv: "e7b73111ac30b81f9b86422168b8e156"
server_key_version: "encryptionkey@0"
I20260807 19:51:56.866914 3803 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:56.897651 3803 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:56.902278 3803 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:56.902536 3803 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:56.903448 3803 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:56.904762 3803 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:56.904836 3803 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:56.904937 3803 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:56.905025 3803 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:56.939668 3803 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:38057
I20260807 19:51:56.939715 4007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:38057 every 8 connection(s)
I20260807 19:51:56.941102 3803 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:51:56.951287 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 3803
I20260807 19:51:56.951485 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:51:56.951926 12910 external_mini_cluster.cc:1428] Setting key f380dfea61f9f87bb7176fd64afb26c5
Aug 07 19:51:56 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132316, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:56.961349 4016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:56.943877 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:49527 (local address 127.12.155.190:45949)
0807 19:51:56.944369 (+ 492us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:56.944373 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:56.945136 (+ 763us) server_negotiation.cc:407] Connection header received
0807 19:51:56.947040 (+ 1904us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:56.947046 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:56.947156 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:56.947286 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:56.948812 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.949613 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.951246 (+ 1633us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.951765 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.951903 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:56.955994 (+ 4091us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:56.955998 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:56.956002 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:56.956034 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:56.958584 (+ 2550us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:56.959305 (+ 721us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:56.959308 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:56.959311 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:56.959435 (+ 124us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:56.959843 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:56.959846 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:56.959848 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:56.960099 (+ 251us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:56.960229 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:56.960893 (+ 664us) server_negotiation.cc:299] Negotiation successful
0807 19:51:56.961057 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":395,"thread_start_us":262,"threads_started":1}
I20260807 19:51:56.962368 4017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:56.944273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:49527)
0807 19:51:56.944965 (+ 692us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:56.945012 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:56.946766 (+ 1754us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:56.947528 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:56.947536 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:56.948035 (+ 499us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:56.948624 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:56.948642 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.949777 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.949787 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:56.951086 (+ 1299us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:56.951098 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.952014 (+ 916us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.952022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:56.952261 (+ 239us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:56.953079 (+ 818us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:56.953110 (+ 31us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:56.955813 (+ 2703us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:56.958727 (+ 2914us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:56.958734 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:56.958747 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:56.959185 (+ 438us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:56.959525 (+ 340us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:56.959528 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:56.959531 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:56.959739 (+ 208us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:56.960203 (+ 464us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:56.960209 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:56.960530 (+ 321us) client_negotiation.cc:769] Sending connection context
0807 19:51:56.960784 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 19:51:56.961167 (+ 383us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":470,"thread_start_us":295,"threads_started":1}
I20260807 19:51:56.963812 4008 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45949
I20260807 19:51:56.964084 4008 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:56.964784 4008 heartbeater.cc:511] Master 127.12.155.190:45949 requested a full tablet report, sending...
I20260807 19:51:56.966337 3285 ts_manager.cc:194] Registered new tserver with Master: f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057)
I20260807 19:51:56.967320 3285 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:49527
I20260807 19:51:56.967882 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:51:56.984874 4016 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:56.972493 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55928 (local address 127.12.155.190:45949)
0807 19:51:56.972715 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:56.972723 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:56.973050 (+ 327us) server_negotiation.cc:407] Connection header received
0807 19:51:56.973213 (+ 163us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:56.973217 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:56.973305 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:56.973385 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:56.974906 (+ 1521us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.975675 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.976990 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:56.977379 (+ 389us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:56.977475 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:56.979893 (+ 2418us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:56.979897 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:56.979900 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:56.979931 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:56.982502 (+ 2571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:56.983124 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:56.983127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:56.983129 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:56.983252 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:56.983572 (+ 320us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:56.983575 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:56.983577 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:56.983883 (+ 306us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:56.984059 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:56.984356 (+ 297us) server_negotiation.cc:299] Negotiation successful
0807 19:51:56.984536 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:51:56.988950 3285 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55928:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:51:56.995972 3285 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:51:57.034897 4037 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.009820 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38057 (local address 127.0.0.1:40538)
0807 19:51:57.020642 (+ 10822us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.020710 (+ 68us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:57.021715 (+ 1005us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:57.027137 (+ 5422us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:57.027148 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:57.027193 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:57.027723 (+ 530us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.027739 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.030100 (+ 2361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.030105 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.032353 (+ 2248us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.032369 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.033698 (+ 1329us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.033704 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.033955 (+ 251us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.034023 (+ 68us) client_negotiation.cc:769] Sending connection context
0807 19:51:57.034161 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 19:51:57.034395 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":10455,"mutex_wait_us":60,"thread_start_us":17007,"threads_started":1}
I20260807 19:51:57.035782 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.009895 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40538 (local address 127.12.155.131:38057)
0807 19:51:57.026198 (+ 16303us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.026208 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.026247 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:51:57.026363 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.026373 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.026676 (+ 303us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.027809 (+ 1133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:57.028200 (+ 391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.029862 (+ 1662us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.032518 (+ 2656us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.033477 (+ 959us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.034930 (+ 1453us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.035133 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.035212 (+ 79us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.035412 (+ 200us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16050,"thread_start_us":16915,"threads_started":1}
I20260807 19:51:57.036193 4036 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.009875 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:34059 (local address 127.0.0.1:46106)
0807 19:51:57.026613 (+ 16738us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.026633 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:57.026760 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:57.028903 (+ 2143us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:57.028908 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:57.028932 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:57.029461 (+ 529us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.029476 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.031178 (+ 1702us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.031186 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.033404 (+ 2218us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.033420 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.035412 (+ 1992us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.035418 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.035623 (+ 205us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.035656 (+ 33us) client_negotiation.cc:769] Sending connection context
0807 19:51:57.035728 (+ 72us) client_negotiation.cc:240] Negotiation successful
0807 19:51:57.035874 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":16612,"mutex_wait_us":3,"thread_start_us":9851,"threads_started":1}
I20260807 19:51:57.037003 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.010550 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46106 (local address 127.12.155.130:34059)
0807 19:51:57.028329 (+ 17779us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.028337 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.028366 (+ 29us) server_negotiation.cc:407] Connection header received
0807 19:51:57.028463 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.028469 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.028686 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.029638 (+ 952us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:57.029861 (+ 223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.031040 (+ 1179us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.033664 (+ 2624us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.035182 (+ 1518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.036477 (+ 1295us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.036599 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.036653 (+ 54us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.036767 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":17601,"thread_start_us":17431,"threads_started":1}
I20260807 19:51:57.038750 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.025500 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:43980)
0807 19:51:57.027435 (+ 1935us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.027454 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:57.027592 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:57.029200 (+ 1608us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:57.029204 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:57.029230 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:57.029765 (+ 535us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.029780 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.031825 (+ 2045us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.031831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.034021 (+ 2190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.034034 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.037856 (+ 3822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.037865 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.038054 (+ 189us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.038131 (+ 77us) client_negotiation.cc:769] Sending connection context
0807 19:51:57.038236 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 19:51:57.038362 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1794,"mutex_wait_us":1,"thread_start_us":1618,"threads_started":1}
I20260807 19:51:57.038769 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.021243 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43980 (local address 127.12.155.129:34755)
0807 19:51:57.025574 (+ 4331us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.025587 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.027593 (+ 2006us) server_negotiation.cc:407] Connection header received
0807 19:51:57.027764 (+ 171us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.027775 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.028480 (+ 705us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.028682 (+ 202us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:57.029982 (+ 1300us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.031662 (+ 1680us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.034238 (+ 2576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.037621 (+ 3383us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.037853 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.038039 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.038294 (+ 255us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.038457 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":4081,"thread_start_us":3889,"threads_started":1}
I20260807 19:51:57.040123 3902 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 (DEFAULT_TABLE table=test-table [id=6bc8527033ea4ce39621003a85b29ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:57.040534 3701 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 (DEFAULT_TABLE table=test-table [id=6bc8527033ea4ce39621003a85b29ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:57.041687 3902 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:57.041936 3701 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:57.042765 3489 tablet_service.cc:1467] Processing CreateTablet for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 (DEFAULT_TABLE table=test-table [id=6bc8527033ea4ce39621003a85b29ccc]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:57.044212 3489 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:57.058130 4046 tablet_bootstrap.cc:492] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Bootstrap starting.
I20260807 19:51:57.060040 4047 tablet_bootstrap.cc:492] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Bootstrap starting.
I20260807 19:51:57.062362 4046 tablet_bootstrap.cc:654] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:57.063441 4046 log.cc:824] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:57.064553 4047 tablet_bootstrap.cc:654] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:57.066205 4046 tablet_bootstrap.cc:492] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: No bootstrap required, opened a new log
I20260807 19:51:57.066210 4047 log.cc:824] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:57.066601 4046 ts_tablet_manager.cc:1397] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260807 19:51:57.066830 4048 tablet_bootstrap.cc:492] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Bootstrap starting.
I20260807 19:51:57.070008 4047 tablet_bootstrap.cc:492] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: No bootstrap required, opened a new log
I20260807 19:51:57.070338 4047 ts_tablet_manager.cc:1397] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Time spent bootstrapping tablet: real 0.011s user 0.004s sys 0.006s
I20260807 19:51:57.070647 4048 tablet_bootstrap.cc:654] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:57.072197 4048 log.cc:824] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:57.078438 4047 raft_consensus.cc:348] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.078922 4047 raft_consensus.cc:374] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:57.079038 4047 raft_consensus.cc:729] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e4f01bb6d54776904626a400bad314, State: Initialized, Role: FOLLOWER
I20260807 19:51:57.078835 4046 raft_consensus.cc:348] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.079311 4046 raft_consensus.cc:374] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:57.079438 4046 raft_consensus.cc:729] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75cedda503084c78ad35d495e7bf3608, State: Initialized, Role: FOLLOWER
I20260807 19:51:57.079949 4046 consensus_queue.cc:260] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.079919 4047 consensus_queue.cc:260] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.081102 4048 tablet_bootstrap.cc:492] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: No bootstrap required, opened a new log
I20260807 19:51:57.081432 4048 ts_tablet_manager.cc:1397] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Time spent bootstrapping tablet: real 0.015s user 0.009s sys 0.005s
I20260807 19:51:57.081557 4008 heartbeater.cc:503] Master 127.12.155.190:45949 was elected leader, sending a full tablet report...
I20260807 19:51:57.081744 4046 ts_tablet_manager.cc:1428] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Time spent starting tablet: real 0.015s user 0.010s sys 0.004s
I20260807 19:51:57.082172 4047 ts_tablet_manager.cc:1428] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260807 19:51:57.083040 3793 heartbeater.cc:503] Master 127.12.155.190:45949 was elected leader, sending a full tablet report...
I20260807 19:51:57.090312 4048 raft_consensus.cc:348] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.090653 4048 raft_consensus.cc:374] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:57.090725 4048 raft_consensus.cc:729] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086e5dfe99fd45d8a0b36f361bd65625, State: Initialized, Role: FOLLOWER
I20260807 19:51:57.091204 4048 consensus_queue.cc:260] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.092795 4048 ts_tablet_manager.cc:1428] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Time spent starting tablet: real 0.011s user 0.010s sys 0.000s
I20260807 19:51:57.094835 4057 raft_consensus.cc:482] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:51:57.095108 4057 raft_consensus.cc:504] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.096936 4057 leader_election.cc:288] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059), 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755)
I20260807 19:51:57.103853 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.097359 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:57939 (local address 127.12.155.130:34059)
0807 19:51:57.097588 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.097593 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.097609 (+ 16us) server_negotiation.cc:407] Connection header received
0807 19:51:57.097665 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.097668 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.097740 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.097851 (+ 111us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:57.098479 (+ 628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.099565 (+ 1086us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.101747 (+ 2182us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.103001 (+ 1254us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.103181 (+ 180us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.103251 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.103571 (+ 320us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.103662 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":96}
I20260807 19:51:57.103940 4017 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.097107 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:34059 (local address 127.12.155.131:57939)
0807 19:51:57.097295 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.097316 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:57.097432 (+ 116us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:57.097902 (+ 470us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:57.097911 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:57.097953 (+ 42us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:57.098316 (+ 363us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.098328 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.099706 (+ 1378us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.099711 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.101553 (+ 1842us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.101592 (+ 39us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.103190 (+ 1598us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.103196 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.103391 (+ 195us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.103427 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:51:57.103525 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:51:57.103664 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":54}
I20260807 19:51:57.105120 4060 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.097503 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.12.155.131:35337)
0807 19:51:57.098558 (+ 1055us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.098578 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:57.098715 (+ 137us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:57.099000 (+ 285us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:57.099004 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:57.099030 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:57.099387 (+ 357us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.099398 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.100847 (+ 1449us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.100852 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.103035 (+ 2183us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:57.103051 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.104585 (+ 1534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.104590 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:57.104705 (+ 115us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.104729 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:51:57.104804 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 19:51:57.104887 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":920,"thread_start_us":720,"threads_started":1}
I20260807 19:51:57.105253 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.097663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:35337 (local address 127.12.155.129:34755)
0807 19:51:57.097894 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.097902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.098678 (+ 776us) server_negotiation.cc:407] Connection header received
0807 19:51:57.098830 (+ 152us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.098833 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.098885 (+ 52us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.098953 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:57.099638 (+ 685us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.100674 (+ 1036us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.103196 (+ 2522us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.104378 (+ 1182us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.104537 (+ 159us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.104617 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.104860 (+ 243us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.104993 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:51:57.105100 3731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7a7cc1fca34e8ab4a10ee289cc2228" candidate_uuid: "f6e4f01bb6d54776904626a400bad314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75cedda503084c78ad35d495e7bf3608" is_pre_election: true
I20260807 19:51:57.105762 3731 raft_consensus.cc:2454] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6e4f01bb6d54776904626a400bad314 in term 0.
I20260807 19:51:57.106513 3832 leader_election.cc:302] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314; no voters:
I20260807 19:51:57.106925 4057 raft_consensus.cc:2781] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:51:57.107085 4057 raft_consensus.cc:482] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:51:57.107213 4057 raft_consensus.cc:3037] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:57.107046 3519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7a7cc1fca34e8ab4a10ee289cc2228" candidate_uuid: "f6e4f01bb6d54776904626a400bad314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086e5dfe99fd45d8a0b36f361bd65625" is_pre_election: true
I20260807 19:51:57.107613 3519 raft_consensus.cc:2454] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f6e4f01bb6d54776904626a400bad314 in term 0.
I20260807 19:51:57.109618 4057 raft_consensus.cc:504] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.110301 4057 leader_election.cc:288] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [CANDIDATE]: Term 1 election: Requested vote from peers 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059), 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755)
I20260807 19:51:57.110772 3731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7a7cc1fca34e8ab4a10ee289cc2228" candidate_uuid: "f6e4f01bb6d54776904626a400bad314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "75cedda503084c78ad35d495e7bf3608"
I20260807 19:51:57.110831 3519 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8f7a7cc1fca34e8ab4a10ee289cc2228" candidate_uuid: "f6e4f01bb6d54776904626a400bad314" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086e5dfe99fd45d8a0b36f361bd65625"
I20260807 19:51:57.110977 3731 raft_consensus.cc:3037] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:57.111033 3519 raft_consensus.cc:3037] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:51:57.113292 3519 raft_consensus.cc:2454] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6e4f01bb6d54776904626a400bad314 in term 1.
I20260807 19:51:57.113463 3731 raft_consensus.cc:2454] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f6e4f01bb6d54776904626a400bad314 in term 1.
I20260807 19:51:57.113664 3832 leader_election.cc:302] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625, f6e4f01bb6d54776904626a400bad314; no voters:
I20260807 19:51:57.113965 4057 raft_consensus.cc:2781] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:51:57.114444 4057 raft_consensus.cc:686] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 1 LEADER]: Becoming Leader. State: Replica: f6e4f01bb6d54776904626a400bad314, State: Running, Role: LEADER
I20260807 19:51:57.114920 4057 consensus_queue.cc:237] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } }
I20260807 19:51:57.119798 3281 catalog_manager.cc:5495] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 reported cstate change: term changed from 0 to 1, leader changed from <none> to f6e4f01bb6d54776904626a400bad314 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "f6e4f01bb6d54776904626a400bad314" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } health_report { overall_health: UNKNOWN } } }
W20260807 19:51:57.127539 3795 tablet.cc:2369] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:51:57.159507 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.154047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40552 (local address 127.12.155.131:38057)
0807 19:51:57.154294 (+ 247us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.154302 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.154339 (+ 37us) server_negotiation.cc:407] Connection header received
0807 19:51:57.154442 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.154446 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.154525 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.154685 (+ 160us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:51:57.155071 (+ 386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.155809 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.157276 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.157687 (+ 411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.157827 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.158474 (+ 647us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:51:57.158995 (+ 521us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:51:57.159112 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.159234 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.159308 (+ 74us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:51:57.168522 3519 raft_consensus.cc:1261] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Refusing update from remote peer f6e4f01bb6d54776904626a400bad314: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:51:57.168522 3731 raft_consensus.cc:1261] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Refusing update from remote peer f6e4f01bb6d54776904626a400bad314: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:51:57.169713 4062 consensus_queue.cc:1035] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:51:57.170046 4057 consensus_queue.cc:1035] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [LEADER]: Connected to new peer: Peer: permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:51:57.189234 4067 mvcc.cc:205] Tried to move back new op lower bound from 7315997971109838848 to 7315997970906406912. Current Snapshot: MvccSnapshot[applied={T|T < 7315997971109838848}]
I20260807 19:51:57.192212 4072 mvcc.cc:205] Tried to move back new op lower bound from 7315997971109838848 to 7315997970906406912. Current Snapshot: MvccSnapshot[applied={T|T < 7315997971109838848}]
I20260807 19:51:57.205814 3281 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:51:57.206139 3281 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:55928:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:51:57.209884 3281 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Sending DeleteTablet for 3 replicas of tablet 8f7a7cc1fca34e8ab4a10ee289cc2228
I20260807 19:51:57.211146 3902 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:51:57 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:40538
I20260807 19:51:57.211341 3701 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:51:57 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:46106
I20260807 19:51:57.211409 3489 tablet_service.cc:1514] Processing DeleteTablet for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:51:57 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:43980
I20260807 19:51:57.212364 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 3384
I20260807 19:51:57.224555 4086 tablet_replica.cc:330] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: stopping tablet replica
I20260807 19:51:57.225179 4086 raft_consensus.cc:2229] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:51:57.225865 4086 raft_consensus.cc:2258] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:51:57.230221 4086 ts_tablet_manager.cc:1905] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:57.234436 4085 tablet_replica.cc:330] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: stopping tablet replica
I20260807 19:51:57.234937 4085 raft_consensus.cc:2229] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:51:57.235988 4085 raft_consensus.cc:2258] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:51:57.236788 4087 tablet_replica.cc:330] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: stopping tablet replica
I20260807 19:51:57.237239 4087 raft_consensus.cc:2229] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:51:57.237748 4087 raft_consensus.cc:2258] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:51:57.239837 4086 ts_tablet_manager.cc:1918] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:51:57.239987 4085 ts_tablet_manager.cc:1905] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:57.240082 4086 log.cc:1196] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/8f7a7cc1fca34e8ab4a10ee289cc2228
Aug 07 19:51:57 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:51:57.240787 4086 ts_tablet_manager.cc:1939] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 75cedda503084c78ad35d495e7bf3608: Deleting consensus metadata
I20260807 19:51:57.242795 3258 catalog_manager.cc:4841] TS 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 (table test-table [id=6bc8527033ea4ce39621003a85b29ccc]) successfully deleted
I20260807 19:51:57.245138 4087 ts_tablet_manager.cc:1905] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:57.248229 4085 ts_tablet_manager.cc:1918] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:51:57.248469 4085 log.cc:1196] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/8f7a7cc1fca34e8ab4a10ee289cc2228
I20260807 19:51:57.249125 4085 ts_tablet_manager.cc:1939] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P f6e4f01bb6d54776904626a400bad314: Deleting consensus metadata
I20260807 19:51:57.249840 4043 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.214893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43986 (local address 127.12.155.129:34755)
0807 19:51:57.215059 (+ 166us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.215065 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.226988 (+ 11923us) server_negotiation.cc:407] Connection header received
0807 19:51:57.227361 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.227371 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.227480 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.227570 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:57.230196 (+ 2626us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.231839 (+ 1643us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.234621 (+ 2782us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.235575 (+ 954us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.235698 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.241840 (+ 6142us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:57.241861 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:57.241879 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:57.241926 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:57.245962 (+ 4036us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:57.246952 (+ 990us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:57.246963 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:57.246967 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:57.247171 (+ 204us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:57.247662 (+ 491us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:57.247668 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:57.247671 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:57.248165 (+ 494us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:57.248480 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.249112 (+ 632us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.249367 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":41}
I20260807 19:51:57.251427 3579 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:57.253357 3262 catalog_manager.cc:4841] TS f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): tablet 8f7a7cc1fca34e8ab4a10ee289cc2228 (table test-table [id=6bc8527033ea4ce39621003a85b29ccc]) successfully deleted
I20260807 19:51:57.342347 4087 ts_tablet_manager.cc:1918] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:51:57.342643 4087 log.cc:1196] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/8f7a7cc1fca34e8ab4a10ee289cc2228
I20260807 19:51:57.343175 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 3384
I20260807 19:51:57.343318 4087 ts_tablet_manager.cc:1939] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Deleting consensus metadata
W20260807 19:51:57.372897 3258 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:34755 (error 108)
I20260807 19:51:57.373279 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 3596
I20260807 19:51:57.389249 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.388747 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:43996)
0807 19:51:57.388952 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.389075 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 19:51:57.389734 3258 catalog_manager.cc:4584] TS 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8f7a7cc1fca34e8ab4a10ee289cc2228: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Aug 07 19:51:57 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:51:57.398259 4042 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.374475 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46118 (local address 127.12.155.130:34059)
0807 19:51:57.374769 (+ 294us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.374779 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.375773 (+ 994us) server_negotiation.cc:407] Connection header received
0807 19:51:57.375870 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.375887 (+ 17us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.376034 (+ 147us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.376177 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:57.379111 (+ 2934us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.380831 (+ 1720us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.383770 (+ 2939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.384641 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.384761 (+ 120us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.391471 (+ 6710us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:57.391484 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:57.391500 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:57.391551 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:57.394995 (+ 3444us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:57.395814 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:57.395823 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:57.395825 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:57.395954 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:57.396393 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:57.396398 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:57.396400 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:57.396861 (+ 461us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:57.397194 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.397563 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.397808 (+ 245us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":97}
I20260807 19:51:57.399050 3787 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:57.444020 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.443396 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44006)
0807 19:51:57.443651 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.443777 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 19:51:57.445250 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.444826 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44022)
0807 19:51:57.445000 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.445117 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 19:51:57.495800 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 3596
I20260807 19:51:57.506155 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.505535 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44034)
0807 19:51:57.505764 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.505880 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":65}
I20260807 19:51:57.507371 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.507027 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44048)
0807 19:51:57.507180 (+ 153us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.507263 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 19:51:57.531443 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 3803
Aug 07 19:51:57 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132314, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:51:57.548375 4040 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.532476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40568 (local address 127.12.155.131:38057)
0807 19:51:57.532715 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:57.532721 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:57.532744 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:51:57.532806 (+ 62us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:57.532809 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:57.532870 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:57.532993 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:57.534463 (+ 1470us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.535313 (+ 850us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.536861 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:57.537346 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:57.537509 (+ 163us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:57.542030 (+ 4521us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:57.542043 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:57.542123 (+ 80us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:57.542183 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:57.545368 (+ 3185us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:57.546090 (+ 722us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:57.546101 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:57.546105 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:57.546272 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:57.546688 (+ 416us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:57.546693 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:57.546696 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:57.547087 (+ 391us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:57.547450 (+ 363us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:57.547740 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 19:51:57.547987 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 19:51:57.549117 4002 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:57.588922 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.588335 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44064)
0807 19:51:57.588609 (+ 274us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.588756 (+ 147us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":109}
I20260807 19:51:57.590111 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.589686 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44076)
0807 19:51:57.589886 (+ 200us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.589953 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260807 19:51:57.679162 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 3803
I20260807 19:51:57.709630 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 3228
I20260807 19:51:57.710968 3330 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:51:57.823975 4045 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:57.823355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44088)
0807 19:51:57.823588 (+ 233us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:57.823710 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:51:57.824214 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 3228
I20260807 19:51:57.854986 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45949
--webserver_interface=127.12.155.190
--webserver_port=46173
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:45949
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--ipki_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:51:58.199025 4095 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:58.199333 4095 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:58.199507 4095 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:58.207075 4095 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:51:58.207204 4095 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:58.207314 4095 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:58.207412 4095 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:51:58.207491 4095 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:51:58.217711 4095 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_private_key_password_cmd=echo foo
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:45949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=46173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:58.219060 4095 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:58.220377 4095 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:58.245774 4107 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:58.245908 4106 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:58.245883 4110 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:58.247081 4095 server_base.cc:1034] running on GCE node
I20260807 19:51:58.247991 4095 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:58.249650 4095 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:58.250908 4095 hybrid_clock.cc:648] HybridClock initialized: now 1786132318250855 us; error 57 us; skew 500 ppm
I20260807 19:51:58.251355 4095 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:58 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:58.259394 4095 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:51:58.261104 4095 webserver.cc:460] Webserver started at http://127.12.155.190:46173/ using document root <none> and password file <none>
I20260807 19:51:58.261893 4095 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:58.262113 4095 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:58.268402 4095 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.003s
I20260807 19:51:58.271775 4122 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:58.273239 4095 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:51:58.273442 4095 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "1cbfe5ac362142b188d5e2bd59705f1a"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b69c61f39f661807a43ba2ae5bb4da69"
server_key_iv: "4dd13a51bb054ed21cc1901e48cf6dc9"
server_key_version: "encryptionkey@0"
I20260807 19:51:58.274672 4095 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:58.289243 4095 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:58.294148 4095 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:58.294442 4095 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:58.315001 4095 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:45949
I20260807 19:51:58.315033 4199 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:45949 every 8 connection(s)
I20260807 19:51:58.316622 4095 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:51:58.323736 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 4095
I20260807 19:51:58.323870 4200 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:51:58.324632 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:34755
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:45949
--webserver_port=34203
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:51:58.327378 4200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap starting.
I20260807 19:51:58.351465 4200 log.cc:824] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:58.368389 4200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:51:58.369102 4200 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap complete.
I20260807 19:51:58.383543 4200 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:58.384784 4200 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbfe5ac362142b188d5e2bd59705f1a, State: Initialized, Role: FOLLOWER
I20260807 19:51:58.385524 4200 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:58.385816 4200 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:51:58.385946 4200 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:51:58.386164 4200 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:51:58.392284 4200 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:58.393052 4200 leader_election.cc:302] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cbfe5ac362142b188d5e2bd59705f1a; no voters:
I20260807 19:51:58.393774 4200 leader_election.cc:288] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:51:58.393929 4205 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:51:58.395324 4205 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 LEADER]: Becoming Leader. State: Replica: 1cbfe5ac362142b188d5e2bd59705f1a, State: Running, Role: LEADER
I20260807 19:51:58.395980 4205 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:51:58.396152 4200 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:51:58.398576 4209 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cbfe5ac362142b188d5e2bd59705f1a. Latest consensus state: current_term: 2 leader_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } } }
I20260807 19:51:58.398964 4209 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:58.399525 4206 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } } }
I20260807 19:51:58.399863 4206 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: This master's current role is: LEADER
I20260807 19:51:58.402276 4216 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:51:58.411669 4216 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:51:58.413233 4216 catalog_manager.cc:1259] Loaded cluster ID: 922ad8d3844346ae9e589cc0e1054d0a
I20260807 19:51:58.413405 4216 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:51:58.416930 4216 catalog_manager.cc:1314] IPKI private key was stored in cleartext, attempting to encrypt it.
I20260807 19:51:58.435456 4216 catalog_manager.cc:1324] IPKI private key successfully encrypted.
I20260807 19:51:58.453907 4216 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:51:58.455843 4216 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Loaded TSK: 0
I20260807 19:51:58.457460 4216 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 19:51:58.719605 4202 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:58.719924 4202 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:58.720094 4202 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:58.727627 4202 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:58.727782 4202 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:58.727952 4202 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:51:58.737715 4202 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:34755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=34203
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:58.739089 4202 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:58.740463 4202 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:58.755476 4241 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:58.755450 4242 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:58.756313 4244 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:58.756652 4202 server_base.cc:1034] running on GCE node
I20260807 19:51:58.757340 4202 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:58.758699 4202 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:58.759935 4202 hybrid_clock.cc:648] HybridClock initialized: now 1786132318759867 us; error 55 us; skew 500 ppm
I20260807 19:51:58.760280 4202 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:58 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:58.763623 4202 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:51:58.765347 4202 webserver.cc:460] Webserver started at http://127.12.155.129:34203/ using document root <none> and password file <none>
I20260807 19:51:58.766108 4202 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:58.766288 4202 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:58.772143 4202 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.005s sys 0.000s
I20260807 19:51:58.775068 4252 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:58.776521 4202 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:58.776726 4202 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "086e5dfe99fd45d8a0b36f361bd65625"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b24cf7cee836097dbdd23452a37c59cc"
server_key_iv: "5eb95d3538836bbd47a8ae21d875823b"
server_key_version: "encryptionkey@0"
I20260807 19:51:58.777740 4202 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:58.796823 4202 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:58.801393 4202 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:58.801695 4202 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:58.802847 4202 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:58.804754 4264 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
W20260807 19:51:58.810931 4264 ts_tablet_manager.cc:1852] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Tablet Manager startup: Rolling forward tablet deletion of type TABLET_DATA_DELETED
I20260807 19:51:58.812119 4264 ts_tablet_manager.cc:1905] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:51:58.820336 4264 ts_tablet_manager.cc:1918] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:51:58.820652 4264 ts_tablet_manager.cc:1939] T 8f7a7cc1fca34e8ab4a10ee289cc2228 P 086e5dfe99fd45d8a0b36f361bd65625: Deleting consensus metadata
I20260807 19:51:58.821179 4202 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 0 live tablets)
I20260807 19:51:58.821349 4202 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.017s user 0.001s sys 0.000s
I20260807 19:51:58.821564 4202 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:58.821672 4202 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:58.858114 4202 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34755
I20260807 19:51:58.858220 4442 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34755 every 8 connection(s)
I20260807 19:51:58.859640 4202 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:51:58.869760 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 4202
I20260807 19:51:58.870558 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:34059
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:45949
--webserver_port=38911
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:51:58 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132318, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:58.885751 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:58.863157 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:34705 (local address 127.12.155.190:45949)
0807 19:51:58.863848 (+ 691us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:58.863860 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:58.864759 (+ 899us) server_negotiation.cc:407] Connection header received
0807 19:51:58.867220 (+ 2461us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:58.867238 (+ 18us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:58.867638 (+ 400us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:58.867974 (+ 336us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:58.869760 (+ 1786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:58.871373 (+ 1613us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:58.873005 (+ 1632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:58.873636 (+ 631us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:58.873851 (+ 215us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:58.877429 (+ 3578us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:58.877437 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:58.877452 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:58.877489 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:58.880928 (+ 3439us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:58.881861 (+ 933us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:58.881871 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:58.881877 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:58.882051 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:58.882706 (+ 655us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:58.882713 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:58.882721 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:58.883261 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:58.883401 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:58.884403 (+ 1002us) server_negotiation.cc:299] Negotiation successful
0807 19:51:58.884784 (+ 381us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":482,"thread_start_us":277,"threads_started":1}
I20260807 19:51:58.886251 4448 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:58.863375 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:34705)
0807 19:51:58.864489 (+ 1114us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:58.864564 (+ 75us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:58.866627 (+ 2063us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:58.868189 (+ 1562us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:58.868197 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:58.868793 (+ 596us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:58.869476 (+ 683us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:58.869507 (+ 31us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:58.871563 (+ 2056us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:58.871567 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:58.872841 (+ 1274us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:58.872853 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:58.873890 (+ 1037us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:58.873898 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:58.874198 (+ 300us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:58.874909 (+ 711us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:58.874946 (+ 37us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:58.877152 (+ 2206us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:58.881156 (+ 4004us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:58.881165 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:58.881180 (+ 15us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:58.881709 (+ 529us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:58.882236 (+ 527us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:58.882263 (+ 27us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:58.882270 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:58.882514 (+ 244us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:58.883430 (+ 916us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:58.883442 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:58.883909 (+ 467us) client_negotiation.cc:769] Sending connection context
0807 19:51:58.884236 (+ 327us) client_negotiation.cc:240] Negotiation successful
0807 19:51:58.884854 (+ 618us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":764,"thread_start_us":413,"threads_started":1}
I20260807 19:51:58.889531 4443 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45949
I20260807 19:51:58.889874 4443 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:58.890758 4443 heartbeater.cc:511] Master 127.12.155.190:45949 requested a full tablet report, sending...
I20260807 19:51:58.893448 4147 ts_manager.cc:194] Registered new tserver with Master: 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755)
I20260807 19:51:58.895813 4147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:34705
W20260807 19:51:59.218181 4455 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:59.218470 4455 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:59.218566 4455 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:59.225790 4455 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:59.225907 4455 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:59.226019 4455 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:51:59.235863 4455 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:34059
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=38911
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:59.237123 4455 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:59.238489 4455 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:59.252909 4463 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:59.252940 4465 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:59.253191 4462 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:59.253988 4455 server_base.cc:1034] running on GCE node
I20260807 19:51:59.254643 4455 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:59.255589 4455 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:59.256798 4455 hybrid_clock.cc:648] HybridClock initialized: now 1786132319256751 us; error 35 us; skew 500 ppm
I20260807 19:51:59.257119 4455 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:59 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:59.260336 4455 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:51:59.261689 4455 webserver.cc:460] Webserver started at http://127.12.155.130:38911/ using document root <none> and password file <none>
I20260807 19:51:59.262408 4455 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:59.262531 4455 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:59.267796 4455 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:51:59.270623 4480 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:59.271927 4455 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:51:59.272105 4455 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "75cedda503084c78ad35d495e7bf3608"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "3c1244a3bb1455f373d3a3c4a20cb030"
server_key_iv: "e637cf69d8132237808669e2c4f2c25a"
server_key_version: "encryptionkey@0"
I20260807 19:51:59.273049 4455 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:59.303498 4455 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:59.307693 4455 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:59.307987 4455 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:59.309026 4455 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:59.310456 4455 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:59.310542 4455 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:59.310647 4455 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:59.310741 4455 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:59.350698 4455 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34059
I20260807 19:51:59.350826 4677 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34059 every 8 connection(s)
I20260807 19:51:59.352156 4455 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:51:59.352909 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 4455
I20260807 19:51:59.353753 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:38057
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:45949
--webserver_port=46427
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:51:59 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:59.373559 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.355138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:33217 (local address 127.12.155.190:45949)
0807 19:51:59.355333 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.355337 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.356677 (+ 1340us) server_negotiation.cc:407] Connection header received
0807 19:51:59.358534 (+ 1857us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.358540 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.358644 (+ 104us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.358763 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:59.360238 (+ 1475us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.360928 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.362593 (+ 1665us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.363000 (+ 407us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.363140 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.367515 (+ 4375us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:59.367520 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:59.367523 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:59.367557 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:59.370467 (+ 2910us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:59.371261 (+ 794us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:59.371265 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:59.371268 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:59.371395 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:59.371844 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:59.371854 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:59.371856 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:59.372114 (+ 258us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:59.372282 (+ 168us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.372968 (+ 686us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.373194 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:51:59.374581 4684 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.355746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:33217)
0807 19:51:59.356508 (+ 762us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:59.356545 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:59.358266 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:59.358999 (+ 733us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:59.359007 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:59.359494 (+ 487us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:59.360054 (+ 560us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.360070 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.361082 (+ 1012us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.361092 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.362426 (+ 1334us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.362439 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.363232 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.363240 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.363476 (+ 236us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.364257 (+ 781us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:59.364293 (+ 36us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:59.367307 (+ 3014us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:59.370601 (+ 3294us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:59.370610 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:59.370626 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:59.371116 (+ 490us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:59.371520 (+ 404us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:59.371525 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:59.371528 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:59.371718 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:59.372253 (+ 535us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:59.372261 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:59.372595 (+ 334us) client_negotiation.cc:769] Sending connection context
0807 19:51:59.372851 (+ 256us) client_negotiation.cc:240] Negotiation successful
0807 19:51:59.373383 (+ 532us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":310,"threads_started":1}
I20260807 19:51:59.376191 4679 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45949
I20260807 19:51:59.376510 4679 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:59.377308 4679 heartbeater.cc:511] Master 127.12.155.190:45949 requested a full tablet report, sending...
I20260807 19:51:59.378862 4147 ts_manager.cc:194] Registered new tserver with Master: 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
I20260807 19:51:59.379741 4147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:33217
W20260807 19:51:59.707459 4688 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:51:59.707893 4688 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:51:59.708074 4688 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:51:59.716755 4688 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:51:59.716881 4688 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:51:59.716998 4688 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:51:59.727607 4688 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:38057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=46427
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:51:59.728911 4688 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:51:59.730273 4688 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:51:59.743659 4697 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:59.743717 4700 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:51:59.743877 4702 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:51:59.744685 4688 server_base.cc:1034] running on GCE node
I20260807 19:51:59.745258 4688 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:51:59.746224 4688 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:51:59.747432 4688 hybrid_clock.cc:648] HybridClock initialized: now 1786132319747383 us; error 39 us; skew 500 ppm
I20260807 19:51:59.747764 4688 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:51:59 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:51:59.751003 4688 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:51:59.752437 4688 webserver.cc:460] Webserver started at http://127.12.155.131:46427/ using document root <none> and password file <none>
I20260807 19:51:59.753089 4688 fs_manager.cc:359] Metadata directory not provided
I20260807 19:51:59.753211 4688 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:51:59.758553 4688 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 19:51:59.761274 4716 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:59.762758 4688 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:51:59.762934 4688 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "f6e4f01bb6d54776904626a400bad314"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "d9aaf5c04bd3d2519d3d45fc60d10cef"
server_key_iv: "e7b73111ac30b81f9b86422168b8e156"
server_key_version: "encryptionkey@0"
I20260807 19:51:59.763921 4688 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:51:59.775995 4688 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:51:59.780623 4688 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:51:59.780934 4688 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:51:59.782155 4688 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:51:59.783736 4688 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:51:59.783856 4688 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:59.783982 4688 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:51:59.784075 4688 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:51:59.819324 4688 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:38057
I20260807 19:51:59.819367 4890 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:38057 every 8 connection(s)
I20260807 19:51:59.820787 4688 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:51:59.825814 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 4688
Aug 07 19:51:59 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132319, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:51:59.841990 4898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.826834 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55938 (local address 127.12.155.190:45949)
0807 19:51:59.827331 (+ 497us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.827338 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.827691 (+ 353us) server_negotiation.cc:407] Connection header received
0807 19:51:59.827824 (+ 133us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.827831 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.827902 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.828015 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:59.829581 (+ 1566us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.830429 (+ 848us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.831792 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.832358 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.832496 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.835500 (+ 3004us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:59.835507 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:59.835513 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:59.835553 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:59.838799 (+ 3246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:59.839744 (+ 945us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:59.839751 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:59.839755 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:59.839949 (+ 194us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:59.840357 (+ 408us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:59.840362 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:59.840366 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:59.840764 (+ 398us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:59.841059 (+ 295us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.841305 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.841567 (+ 262us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":32,"server-negotiator.queue_time_us":392,"thread_start_us":258,"threads_started":1}
I20260807 19:51:59.843290 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.823425 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:33403 (local address 127.12.155.190:45949)
0807 19:51:59.823628 (+ 203us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.823632 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.824755 (+ 1123us) server_negotiation.cc:407] Connection header received
0807 19:51:59.827202 (+ 2447us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.827208 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.827294 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.827374 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:51:59.829293 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.830126 (+ 833us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.831657 (+ 1531us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.832157 (+ 500us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.832298 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.836285 (+ 3987us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:51:59.836295 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:51:59.836301 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:51:59.836356 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:51:59.839646 (+ 3290us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:59.840635 (+ 989us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:59.840639 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:59.840641 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:59.840767 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:51:59.841313 (+ 546us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:51:59.841318 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:51:59.841321 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:51:59.841685 (+ 364us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:51:59.841830 (+ 145us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.842748 (+ 918us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.842941 (+ 193us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":68}
I20260807 19:51:59.844599 4896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.823877 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:33403)
0807 19:51:59.824591 (+ 714us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:59.824629 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:59.826852 (+ 2223us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:59.827874 (+ 1022us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:59.827887 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:59.828548 (+ 661us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:51:59.829119 (+ 571us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.829137 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.830290 (+ 1153us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.830294 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.831510 (+ 1216us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.831522 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.832388 (+ 866us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.832398 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.832658 (+ 260us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.833494 (+ 836us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:51:59.833516 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:51:59.835936 (+ 2420us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:51:59.839806 (+ 3870us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:59.839818 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:59.839838 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:59.840513 (+ 675us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:59.840883 (+ 370us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:51:59.840888 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:51:59.840891 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:51:59.841182 (+ 291us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:51:59.841871 (+ 689us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:51:59.841879 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:51:59.842315 (+ 436us) client_negotiation.cc:769] Sending connection context
0807 19:51:59.842660 (+ 345us) client_negotiation.cc:240] Negotiation successful
0807 19:51:59.843214 (+ 554us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":471,"thread_start_us":280,"threads_started":1}
I20260807 19:51:59.845893 4893 heartbeater.cc:347] Connected to a master server at 127.12.155.190:45949
I20260807 19:51:59.846262 4893 heartbeater.cc:464] Registering TS with master...
I20260807 19:51:59.846992 4893 heartbeater.cc:511] Master 127.12.155.190:45949 requested a full tablet report, sending...
I20260807 19:51:59.848318 4147 ts_manager.cc:194] Registered new tserver with Master: f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057)
I20260807 19:51:59.849128 4147 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:33403
I20260807 19:51:59.857115 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:51:59.864413 4446 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.858021 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55954 (local address 127.12.155.190:45949)
0807 19:51:59.858234 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.858242 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.858726 (+ 484us) server_negotiation.cc:407] Connection header received
0807 19:51:59.858910 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.858916 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.859072 (+ 156us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.859222 (+ 150us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:51:59.859576 (+ 354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.860677 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.862224 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.862829 (+ 605us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.862966 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.863441 (+ 475us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:51:59.863908 (+ 467us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:51:59.864020 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.864169 (+ 149us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.864241 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:51:59.865265 4147 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin'} at 127.0.0.1:55954:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:51:59.872802 4147 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:51:59.899163 4912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.885447 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44092 (local address 127.12.155.129:34755)
0807 19:51:59.886265 (+ 818us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.886278 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.887718 (+ 1440us) server_negotiation.cc:407] Connection header received
0807 19:51:59.887849 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.887861 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.888190 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.888420 (+ 230us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:59.889666 (+ 1246us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.891756 (+ 2090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.896290 (+ 4534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.897806 (+ 1516us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.898019 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.898264 (+ 245us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.898632 (+ 368us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.898826 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":551,"thread_start_us":366,"threads_started":1}
I20260807 19:51:59.899178 4910 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.885085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44092)
0807 19:51:59.887462 (+ 2377us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:59.887481 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:59.887591 (+ 110us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:59.888750 (+ 1159us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:59.888761 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:59.888802 (+ 41us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:59.889394 (+ 592us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.889410 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.891969 (+ 2559us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.891977 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.895167 (+ 3190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.895190 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.898027 (+ 2837us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.898033 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.898331 (+ 298us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.898412 (+ 81us) client_negotiation.cc:769] Sending connection context
0807 19:51:59.898551 (+ 139us) client_negotiation.cc:240] Negotiation successful
0807 19:51:59.898764 (+ 213us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2258,"mutex_wait_us":26,"thread_start_us":2136,"threads_started":1}
I20260807 19:51:59.900192 4443 heartbeater.cc:503] Master 127.12.155.190:45949 was elected leader, sending a full tablet report...
I20260807 19:51:59.901515 4339 tablet_service.cc:1467] Processing CreateTablet for tablet 16fefd0dd02a46baab4255102d796e1c (DEFAULT_TABLE table=test-table [id=307b5dff375a4cbf82d8bd80e1a43b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:59.902992 4339 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16fefd0dd02a46baab4255102d796e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:59.904986 4908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.884465 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38057 (local address 127.0.0.1:40576)
0807 19:51:59.886595 (+ 2130us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:59.886638 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:59.886803 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:59.897291 (+ 10488us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:59.897297 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:59.897330 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:59.897730 (+ 400us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.897745 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.900014 (+ 2269us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.900019 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.902461 (+ 2442us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.902477 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.904167 (+ 1690us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.904174 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.904334 (+ 160us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.904371 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:51:59.904496 (+ 125us) client_negotiation.cc:240] Negotiation successful
0807 19:51:59.904628 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1907,"thread_start_us":1769,"threads_started":1}
I20260807 19:51:59.905025 4909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.884820 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40576 (local address 127.12.155.131:38057)
0807 19:51:59.895947 (+ 11127us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.895960 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.896003 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:51:59.896132 (+ 129us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.896143 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.897027 (+ 884us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.897948 (+ 921us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:59.898276 (+ 328us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.899860 (+ 1584us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.902747 (+ 2887us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.903943 (+ 1196us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.904160 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.904325 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.904548 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.904703 (+ 155us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10900,"thread_start_us":10704,"threads_started":1}
I20260807 19:51:59.906329 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.887610 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:34059 (local address 127.0.0.1:46134)
0807 19:51:59.896593 (+ 8983us) negotiation.cc:107] Waiting for socket to connect
0807 19:51:59.896611 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:51:59.896755 (+ 144us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:51:59.897656 (+ 901us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:51:59.897662 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:51:59.897707 (+ 45us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:51:59.898246 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.898260 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.900972 (+ 2712us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.900977 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.903347 (+ 2370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:51:59.903362 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.905559 (+ 2197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.905568 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:51:59.905738 (+ 170us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.905769 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:51:59.905862 (+ 93us) client_negotiation.cc:240] Negotiation successful
0807 19:51:59.905985 (+ 123us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":8815,"mutex_wait_us":28,"thread_start_us":8699,"threads_started":1}
I20260807 19:51:59.906486 4914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:51:59.888226 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46134 (local address 127.12.155.130:34059)
0807 19:51:59.896264 (+ 8038us) server_negotiation.cc:206] Beginning negotiation
0807 19:51:59.896274 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:51:59.896716 (+ 442us) server_negotiation.cc:407] Connection header received
0807 19:51:59.896938 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:51:59.896946 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:51:59.897145 (+ 199us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:51:59.897419 (+ 274us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:51:59.898448 (+ 1029us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.900798 (+ 2350us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.903541 (+ 2743us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:51:59.904972 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:51:59.905507 (+ 535us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:51:59.905663 (+ 156us) server_negotiation.cc:1035] Waiting for connection context
0807 19:51:59.905940 (+ 277us) server_negotiation.cc:299] Negotiation successful
0807 19:51:59.906134 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7853,"thread_start_us":7699,"threads_started":1}
I20260807 19:51:59.908927 4789 tablet_service.cc:1467] Processing CreateTablet for tablet 16fefd0dd02a46baab4255102d796e1c (DEFAULT_TABLE table=test-table [id=307b5dff375a4cbf82d8bd80e1a43b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:59.910125 4789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16fefd0dd02a46baab4255102d796e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:59.909880 4570 tablet_service.cc:1467] Processing CreateTablet for tablet 16fefd0dd02a46baab4255102d796e1c (DEFAULT_TABLE table=test-table [id=307b5dff375a4cbf82d8bd80e1a43b4a]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:51:59.911203 4570 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 16fefd0dd02a46baab4255102d796e1c. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:51:59.916397 4919 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Bootstrap starting.
I20260807 19:51:59.920090 4919 tablet_bootstrap.cc:654] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:59.921386 4919 log.cc:824] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:59.925542 4919 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: No bootstrap required, opened a new log
I20260807 19:51:59.925824 4919 ts_tablet_manager.cc:1397] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Time spent bootstrapping tablet: real 0.010s user 0.007s sys 0.000s
I20260807 19:51:59.926419 4926 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Bootstrap starting.
I20260807 19:51:59.929224 4926 tablet_bootstrap.cc:654] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:59.929376 4921 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Bootstrap starting.
I20260807 19:51:59.930315 4926 log.cc:824] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:59.932716 4926 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: No bootstrap required, opened a new log
I20260807 19:51:59.932816 4921 tablet_bootstrap.cc:654] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Neither blocks nor log segments found. Creating new log.
I20260807 19:51:59.933008 4926 ts_tablet_manager.cc:1397] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260807 19:51:59.934114 4921 log.cc:824] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Log is configured to *not* fsync() on all Append() calls
I20260807 19:51:59.935217 4919 raft_consensus.cc:348] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:51:59.935751 4919 raft_consensus.cc:374] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:59.935910 4919 raft_consensus.cc:729] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086e5dfe99fd45d8a0b36f361bd65625, State: Initialized, Role: FOLLOWER
I20260807 19:51:59.936578 4919 consensus_queue.cc:260] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:51:59.938467 4921 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: No bootstrap required, opened a new log
I20260807 19:51:59.938447 4919 ts_tablet_manager.cc:1428] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Time spent starting tablet: real 0.012s user 0.010s sys 0.004s
I20260807 19:51:59.938747 4921 ts_tablet_manager.cc:1397] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Time spent bootstrapping tablet: real 0.013s user 0.005s sys 0.004s
I20260807 19:51:59.942545 4926 raft_consensus.cc:348] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:51:59.943009 4926 raft_consensus.cc:374] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:59.943145 4926 raft_consensus.cc:729] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 75cedda503084c78ad35d495e7bf3608, State: Initialized, Role: FOLLOWER
I20260807 19:51:59.943805 4926 consensus_queue.cc:260] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:51:59.945019 4679 heartbeater.cc:503] Master 127.12.155.190:45949 was elected leader, sending a full tablet report...
I20260807 19:51:59.945623 4926 ts_tablet_manager.cc:1428] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Time spent starting tablet: real 0.012s user 0.011s sys 0.001s
I20260807 19:51:59.948244 4921 raft_consensus.cc:348] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:51:59.948727 4921 raft_consensus.cc:374] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:51:59.948849 4921 raft_consensus.cc:729] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f6e4f01bb6d54776904626a400bad314, State: Initialized, Role: FOLLOWER
I20260807 19:51:59.949462 4921 consensus_queue.cc:260] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:51:59.950637 4893 heartbeater.cc:503] Master 127.12.155.190:45949 was elected leader, sending a full tablet report...
I20260807 19:51:59.951207 4921 ts_tablet_manager.cc:1428] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Time spent starting tablet: real 0.012s user 0.009s sys 0.003s
W20260807 19:52:00.072434 4895 tablet.cc:2369] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:52:00.104575 4680 tablet.cc:2369] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:52:00.112265 4445 tablet.cc:2369] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:00.115516 4931 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:00.115798 4931 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:00.117415 4931 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755)
I20260807 19:52:00.124502 4912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.118047 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:53703 (local address 127.12.155.129:34755)
0807 19:52:00.118389 (+ 342us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:00.118396 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:00.118646 (+ 250us) server_negotiation.cc:407] Connection header received
0807 19:52:00.118902 (+ 256us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:00.118907 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:00.118989 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:00.119079 (+ 90us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:00.119609 (+ 530us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.120365 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.122591 (+ 2226us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.123520 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.123645 (+ 125us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.123699 (+ 54us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:00.124112 (+ 413us) server_negotiation.cc:299] Negotiation successful
0807 19:52:00.124243 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":154}
I20260807 19:52:00.124774 4909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.118309 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:58333 (local address 127.12.155.131:38057)
0807 19:52:00.118513 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:00.118519 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:00.118988 (+ 469us) server_negotiation.cc:407] Connection header received
0807 19:52:00.119158 (+ 170us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:00.119162 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:00.119220 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:00.119315 (+ 95us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:00.119886 (+ 571us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.120895 (+ 1009us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.122922 (+ 2027us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.123793 (+ 871us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.123940 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.124009 (+ 69us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:00.124371 (+ 362us) server_negotiation.cc:299] Negotiation successful
0807 19:52:00.124517 (+ 146us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":53}
I20260807 19:52:00.124799 4933 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.117714 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.12.155.130:53703)
0807 19:52:00.118516 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.118537 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:00.118741 (+ 204us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:00.119103 (+ 362us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:00.119109 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:00.119132 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:00.119455 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:00.119464 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.120522 (+ 1058us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.120528 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:00.122441 (+ 1913us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:00.122454 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.123734 (+ 1280us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.123742 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:00.123916 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.123956 (+ 40us) client_negotiation.cc:769] Sending connection context
0807 19:52:00.124061 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 19:52:00.124159 (+ 98us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":641,"mutex_wait_us":20,"thread_start_us":429,"threads_started":1}
I20260807 19:52:00.124897 4935 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.117898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38057 (local address 127.12.155.130:58333)
0807 19:52:00.118882 (+ 984us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.118903 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:00.119014 (+ 111us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:00.119332 (+ 318us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:00.119336 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:00.119365 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:00.119741 (+ 376us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:00.119750 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.121070 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.121075 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:00.122771 (+ 1696us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:00.122788 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.123998 (+ 1210us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.124003 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:00.124200 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.124232 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:52:00.124329 (+ 97us) client_negotiation.cc:240] Negotiation successful
0807 19:52:00.124449 (+ 120us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":863,"mutex_wait_us":3,"thread_start_us":626,"threads_started":1}
I20260807 19:52:00.125836 4819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16fefd0dd02a46baab4255102d796e1c" candidate_uuid: "75cedda503084c78ad35d495e7bf3608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e4f01bb6d54776904626a400bad314" is_pre_election: true
I20260807 19:52:00.125977 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16fefd0dd02a46baab4255102d796e1c" candidate_uuid: "75cedda503084c78ad35d495e7bf3608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086e5dfe99fd45d8a0b36f361bd65625" is_pre_election: true
I20260807 19:52:00.126423 4819 raft_consensus.cc:2454] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75cedda503084c78ad35d495e7bf3608 in term 0.
I20260807 19:52:00.126520 4373 raft_consensus.cc:2454] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 75cedda503084c78ad35d495e7bf3608 in term 0.
I20260807 19:52:00.127137 4483 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 3 yes votes; 0 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625, 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314; no voters:
I20260807 19:52:00.127571 4931 raft_consensus.cc:2781] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:52:00.127758 4931 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:52:00.127871 4931 raft_consensus.cc:3037] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:00.130107 4931 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:00.130710 4931 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [CANDIDATE]: Term 1 election: Requested vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755)
I20260807 19:52:00.131163 4373 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16fefd0dd02a46baab4255102d796e1c" candidate_uuid: "75cedda503084c78ad35d495e7bf3608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "086e5dfe99fd45d8a0b36f361bd65625"
I20260807 19:52:00.131168 4819 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16fefd0dd02a46baab4255102d796e1c" candidate_uuid: "75cedda503084c78ad35d495e7bf3608" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f6e4f01bb6d54776904626a400bad314"
I20260807 19:52:00.131343 4373 raft_consensus.cc:3037] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:00.131354 4819 raft_consensus.cc:3037] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:00.133482 4373 raft_consensus.cc:2454] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75cedda503084c78ad35d495e7bf3608 in term 1.
I20260807 19:52:00.133530 4819 raft_consensus.cc:2454] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 75cedda503084c78ad35d495e7bf3608 in term 1.
I20260807 19:52:00.133924 4481 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625, 75cedda503084c78ad35d495e7bf3608; no voters:
I20260807 19:52:00.134323 4931 raft_consensus.cc:2781] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:52:00.134784 4931 raft_consensus.cc:686] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 1 LEADER]: Becoming Leader. State: Replica: 75cedda503084c78ad35d495e7bf3608, State: Running, Role: LEADER
I20260807 19:52:00.135244 4931 consensus_queue.cc:237] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:00.139705 4147 catalog_manager.cc:5495] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 reported cstate change: term changed from 0 to 1, leader changed from <none> to 75cedda503084c78ad35d495e7bf3608 (127.12.155.130). New cstate: current_term: 1 leader_uuid: "75cedda503084c78ad35d495e7bf3608" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } health_report { overall_health: HEALTHY } } }
I20260807 19:52:00.190826 4914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.185264 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46150 (local address 127.12.155.130:34059)
0807 19:52:00.185485 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:00.185492 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:00.185510 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:52:00.185700 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:00.185704 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:00.185782 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:00.185939 (+ 157us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:52:00.186336 (+ 397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.187063 (+ 727us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.188566 (+ 1503us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.188983 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.189122 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.189628 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:52:00.190216 (+ 588us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:52:00.190367 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:00.190471 (+ 104us) server_negotiation.cc:299] Negotiation successful
0807 19:52:00.190554 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:52:00.198858 4819 raft_consensus.cc:1261] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Refusing update from remote peer 75cedda503084c78ad35d495e7bf3608: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:52:00.198861 4373 raft_consensus.cc:1261] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Refusing update from remote peer 75cedda503084c78ad35d495e7bf3608: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:52:00.199805 4936 consensus_queue.cc:1035] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:52:00.200201 4931 consensus_queue.cc:1035] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [LEADER]: Connected to new peer: Peer: permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:52:00.210762 4942 mvcc.cc:205] Tried to move back new op lower bound from 7315997983524777984 to 7315997983277645824. Current Snapshot: MvccSnapshot[applied={T|T < 7315997983524777984}]
I20260807 19:52:00.212994 4943 mvcc.cc:205] Tried to move back new op lower bound from 7315997983524777984 to 7315997983277645824. Current Snapshot: MvccSnapshot[applied={T|T < 7315997983524777984}]
I20260807 19:52:00.226609 4147 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin'} at 127.0.0.1:55954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:52:00.226854 4147 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin'} at 127.0.0.1:55954:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:52:00.230129 4147 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Sending DeleteTablet for 3 replicas of tablet 16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:00.231205 4789 tablet_service.cc:1514] Processing DeleteTablet for tablet 16fefd0dd02a46baab4255102d796e1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:00 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:40576
I20260807 19:52:00.231608 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 4202
I20260807 19:52:00.231766 4339 tablet_service.cc:1514] Processing DeleteTablet for tablet 16fefd0dd02a46baab4255102d796e1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:00 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:44092
I20260807 19:52:00.231918 4570 tablet_service.cc:1514] Processing DeleteTablet for tablet 16fefd0dd02a46baab4255102d796e1c with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:00 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:46134
I20260807 19:52:00.233567 4960 tablet_replica.cc:330] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: stopping tablet replica
I20260807 19:52:00.234100 4960 raft_consensus.cc:2229] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:52:00.234681 4960 raft_consensus.cc:2258] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:00.237335 4962 tablet_replica.cc:330] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: stopping tablet replica
I20260807 19:52:00.237751 4962 raft_consensus.cc:2229] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:52:00.238528 4962 raft_consensus.cc:2258] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:00.238982 4960 ts_tablet_manager.cc:1905] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:00.241678 4962 ts_tablet_manager.cc:1905] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:00.246575 4960 ts_tablet_manager.cc:1918] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:00.246759 4960 log.cc:1196] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:00.247329 4960 ts_tablet_manager.cc:1939] T 16fefd0dd02a46baab4255102d796e1c P f6e4f01bb6d54776904626a400bad314: Deleting consensus metadata
I20260807 19:52:00.247572 4961 tablet_replica.cc:330] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: stopping tablet replica
I20260807 19:52:00.248111 4961 raft_consensus.cc:2229] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:52:00.248731 4961 raft_consensus.cc:2258] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:00.249308 4128 catalog_manager.cc:4841] TS f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): tablet 16fefd0dd02a46baab4255102d796e1c (table test-table [id=307b5dff375a4cbf82d8bd80e1a43b4a]) successfully deleted
I20260807 19:52:00.250829 4961 ts_tablet_manager.cc:1905] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:00.252197 4912 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.232577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44098 (local address 127.12.155.129:34755)
0807 19:52:00.232791 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:00.232800 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:00.232885 (+ 85us) server_negotiation.cc:407] Connection header received
0807 19:52:00.233112 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:00.233123 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:00.233233 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:00.233349 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:00.235201 (+ 1852us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.236748 (+ 1547us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.238718 (+ 1970us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.239390 (+ 672us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.239519 (+ 129us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.243638 (+ 4119us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:00.243658 (+ 20us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:00.243676 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:00.243719 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:00.247883 (+ 4164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:00.248789 (+ 906us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:00.248800 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:00.248807 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:00.248997 (+ 190us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:00.250534 (+ 1537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:00.250539 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:00.250543 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:00.250953 (+ 410us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:00.251277 (+ 324us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:00.251584 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 19:52:00.251816 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:52:00.252986 4436 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:00.258008 4962 ts_tablet_manager.cc:1918] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:00.258263 4962 log.cc:1196] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:00.258780 4962 ts_tablet_manager.cc:1939] T 16fefd0dd02a46baab4255102d796e1c P 75cedda503084c78ad35d495e7bf3608: Deleting consensus metadata
I20260807 19:52:00.260308 4124 catalog_manager.cc:4841] TS 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): tablet 16fefd0dd02a46baab4255102d796e1c (table test-table [id=307b5dff375a4cbf82d8bd80e1a43b4a]) successfully deleted
I20260807 19:52:00.347929 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 4202
I20260807 19:52:00.384037 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 4455
W20260807 19:52:00.383941 4124 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:34755 (error 108)
I20260807 19:52:00.386199 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.385740 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44106)
0807 19:52:00.385897 (+ 157us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.385991 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 19:52:00.386523 4124 catalog_manager.cc:4584] TS 086e5dfe99fd45d8a0b36f361bd65625 (127.12.155.129:34755): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 16fefd0dd02a46baab4255102d796e1c: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
I20260807 19:52:00.400734 4914 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.384849 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46166 (local address 127.12.155.130:34059)
0807 19:52:00.385046 (+ 197us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:00.385055 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:00.385145 (+ 90us) server_negotiation.cc:407] Connection header received
0807 19:52:00.385358 (+ 213us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:00.385364 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:00.385476 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:00.385609 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:00.387788 (+ 2179us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.388570 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.390609 (+ 2039us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.391072 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.391167 (+ 95us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.394538 (+ 3371us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:00.394550 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:00.394565 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:00.394605 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:00.397818 (+ 3213us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:00.398691 (+ 873us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:00.398699 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:00.398701 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:00.398845 (+ 144us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:00.399248 (+ 403us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:00.399251 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:00.399253 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:00.399607 (+ 354us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:00.399862 (+ 255us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:00.400191 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 19:52:00.400353 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:52:00.401468 4672 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:00.440109 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.439631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44114)
0807 19:52:00.439844 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.439962 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 19:52:00.441193 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.440835 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44130)
0807 19:52:00.440983 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.441069 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 19:52:00.501710 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.501231 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44144)
0807 19:52:00.501445 (+ 214us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.501533 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 19:52:00.502766 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.502433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44150)
0807 19:52:00.502581 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.502657 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 19:52:00.513438 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 4455
I20260807 19:52:00.540627 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 4688
I20260807 19:52:00.554802 4909 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.541398 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40588 (local address 127.12.155.131:38057)
0807 19:52:00.541565 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:00.541569 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:00.541631 (+ 62us) server_negotiation.cc:407] Connection header received
0807 19:52:00.541784 (+ 153us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:00.541788 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:00.541861 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:00.541946 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:00.543762 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.544496 (+ 734us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.545802 (+ 1306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:00.546287 (+ 485us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:00.546424 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:00.548965 (+ 2541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:00.548979 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:00.548997 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:00.549031 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:00.551658 (+ 2627us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:00.552381 (+ 723us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:00.552395 (+ 14us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:00.552398 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:00.552571 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:00.552955 (+ 384us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:00.552961 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:00.552964 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:00.553371 (+ 407us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:00.553688 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:00.553995 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 19:52:00.554516 (+ 521us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:52:00.555459 4884 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:00.583180 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.582705 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44158)
0807 19:52:00.582907 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.583001 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:52:00.584199 4913 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:00.583844 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34755 (local address 127.0.0.1:44164)
0807 19:52:00.584025 (+ 181us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:00.584091 (+ 66us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:34755: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":101}
I20260807 19:52:00.645233 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 4688
I20260807 19:52:00.670960 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 4095
I20260807 19:52:00.672292 4194 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:00.788590 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 4095
I20260807 19:52:00.820010 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45949
--webserver_interface=127.12.155.190
--webserver_port=46173
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:45949
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:01.170258 4977 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:01.170605 4977 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:01.170707 4977 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:01.178282 4977 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:52:01.178396 4977 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:01.178443 4977 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:01.178510 4977 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:52:01.178556 4977 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:52:01.188717 4977 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:45949
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:45949
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=46173
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:01.190044 4977 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:01.191368 4977 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:01.206310 4983 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:01.206283 4982 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:01.206584 4989 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:01.208189 4977 server_base.cc:1034] running on GCE node
I20260807 19:52:01.209004 4977 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:01.210465 4977 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:01.211709 4977 hybrid_clock.cc:648] HybridClock initialized: now 1786132321211654 us; error 57 us; skew 500 ppm
I20260807 19:52:01.212071 4977 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:01 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:01.215477 4977 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:52:01.217101 4977 webserver.cc:460] Webserver started at http://127.12.155.190:46173/ using document root <none> and password file <none>
I20260807 19:52:01.217833 4977 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:01.217981 4977 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:01.223780 4977 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:52:01.226701 4999 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:01.228034 4977 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:52:01.228216 4977 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "1cbfe5ac362142b188d5e2bd59705f1a"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b69c61f39f661807a43ba2ae5bb4da69"
server_key_iv: "4dd13a51bb054ed21cc1901e48cf6dc9"
server_key_version: "encryptionkey@0"
I20260807 19:52:01.229276 4977 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:01.260703 4977 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:01.265342 4977 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:01.265637 4977 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:01.285544 4977 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:45949
I20260807 19:52:01.285569 5077 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:45949 every 8 connection(s)
I20260807 19:52:01.287165 4977 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:52:01.294030 5078 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:52:01.297397 5078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap starting.
I20260807 19:52:01.297646 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 4977
I20260807 19:52:01.298748 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:34755
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:45949
--webserver_port=34203
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:52:01.322629 5078 log.cc:824] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:01.339097 5078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=7 ignored=0} mutations{seen=9 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:52:01.339655 5078 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a: Bootstrap complete.
I20260807 19:52:01.348879 5078 raft_consensus.cc:348] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:52:01.349728 5078 raft_consensus.cc:729] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1cbfe5ac362142b188d5e2bd59705f1a, State: Initialized, Role: FOLLOWER
I20260807 19:52:01.350402 5078 consensus_queue.cc:260] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:52:01.350639 5078 raft_consensus.cc:388] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:52:01.350765 5078 raft_consensus.cc:482] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:52:01.350948 5078 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 2 FOLLOWER]: Advancing to term 3
I20260807 19:52:01.354787 5078 raft_consensus.cc:504] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:52:01.355316 5078 leader_election.cc:302] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 1cbfe5ac362142b188d5e2bd59705f1a; no voters:
I20260807 19:52:01.356010 5078 leader_election.cc:288] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 19:52:01.356149 5083 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 3 FOLLOWER]: Leader election won for term 3
I20260807 19:52:01.357585 5083 raft_consensus.cc:686] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [term 3 LEADER]: Becoming Leader. State: Replica: 1cbfe5ac362142b188d5e2bd59705f1a, State: Running, Role: LEADER
I20260807 19:52:01.358260 5083 consensus_queue.cc:237] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } }
I20260807 19:52:01.358475 5078 sys_catalog.cc:564] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:52:01.360859 5085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: SysCatalogTable state changed. Reason: New leader 1cbfe5ac362142b188d5e2bd59705f1a. Latest consensus state: current_term: 3 leader_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } } }
I20260807 19:52:01.361284 5085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: This master's current role is: LEADER
I20260807 19:52:01.361853 5084 sys_catalog.cc:455] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "1cbfe5ac362142b188d5e2bd59705f1a" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 45949 } } }
I20260807 19:52:01.362157 5084 sys_catalog.cc:458] T 00000000000000000000000000000000 P 1cbfe5ac362142b188d5e2bd59705f1a [sys.catalog]: This master's current role is: LEADER
I20260807 19:52:01.372169 5093 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:52:01.381109 5093 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:52:01.382834 5093 catalog_manager.cc:1259] Loaded cluster ID: 922ad8d3844346ae9e589cc0e1054d0a
I20260807 19:52:01.383023 5093 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
F20260807 19:52:01.385219 5093 catalog_manager.cc:1466] Initializing Kudu internal certificate authority failed: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fd83ffd59ad google::LogMessage::Fail() at ??:0
@ 0x7fd83ffd888a google::LogMessage::SendToLog() at ??:0
@ 0x7fd83ffd54de google::LogMessage::Flush() at ??:0
@ 0x7fd83ffd6a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fd855a08512 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fd855a05976 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fd855a8d610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fd855a8d439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fd842c21345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fd842c2491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fd842c24799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fd842bffeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fd845ed96db start_thread at ??:0
@ 0x7fd83ee6f61f clone at ??:0
W20260807 19:52:01.701412 5081 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:01.701689 5081 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:01.701789 5081 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:01.709048 5081 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:01.709151 5081 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:01.709323 5081 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:52:01.720250 5081 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:34755
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=34203
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:01.721582 5081 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:01.723002 5081 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:01.737205 5150 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:01.737231 5152 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:01.737159 5154 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:01.737900 5081 server_base.cc:1034] running on GCE node
I20260807 19:52:01.738524 5081 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:01.739566 5081 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:01.740793 5081 hybrid_clock.cc:648] HybridClock initialized: now 1786132321740742 us; error 52 us; skew 500 ppm
I20260807 19:52:01.741113 5081 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:01 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:01.744264 5081 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:52:01.745693 5081 webserver.cc:460] Webserver started at http://127.12.155.129:34203/ using document root <none> and password file <none>
I20260807 19:52:01.746418 5081 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:01.746523 5081 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:01.751806 5081 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:52:01.754731 5167 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:01.756107 5081 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:52:01.756309 5081 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "086e5dfe99fd45d8a0b36f361bd65625"
format_stamp: "Formatted at 2026-08-07 19:51:55 on dist-test-slave-2p8l"
server_key: "b24cf7cee836097dbdd23452a37c59cc"
server_key_iv: "5eb95d3538836bbd47a8ae21d875823b"
server_key_version: "encryptionkey@0"
I20260807 19:52:01.757287 5081 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:01.782011 5081 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:01.786564 5081 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:01.786867 5081 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:01.787986 5081 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:01.789903 5176 ts_tablet_manager.cc:542] Loading tablet metadata (0/1 complete)
I20260807 19:52:01.795764 5081 ts_tablet_manager.cc:579] Loaded tablet metadata (1 total tablets, 1 live tablets)
I20260807 19:52:01.795915 5081 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.006s user 0.001s sys 0.000s
I20260807 19:52:01.796079 5081 ts_tablet_manager.cc:594] Registering tablets (0/1 complete)
I20260807 19:52:01.799433 5081 ts_tablet_manager.cc:610] Registered 1 tablets
I20260807 19:52:01.799548 5081 ts_tablet_manager.cc:589] Time spent register tablets: real 0.003s user 0.002s sys 0.000s
I20260807 19:52:01.799886 5176 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Bootstrap starting.
I20260807 19:52:01.809104 5176 log.cc:824] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:01.827123 5176 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=1 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:52:01.828305 5176 tablet_bootstrap.cc:492] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Bootstrap complete.
I20260807 19:52:01.829041 5176 ts_tablet_manager.cc:1397] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Time spent bootstrapping tablet: real 0.029s user 0.027s sys 0.000s
I20260807 19:52:01.839871 5081 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34755
I20260807 19:52:01.839906 5350 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34755 every 8 connection(s)
I20260807 19:52:01.841590 5081 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:52:01.842023 5176 raft_consensus.cc:348] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:01.844038 5176 raft_consensus.cc:729] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 086e5dfe99fd45d8a0b36f361bd65625, State: Initialized, Role: FOLLOWER
I20260807 19:52:01.844691 5176 consensus_queue.cc:260] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:01.847421 5176 ts_tablet_manager.cc:1428] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625: Time spent starting tablet: real 0.018s user 0.006s sys 0.011s
I20260807 19:52:01.847445 5354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:01.844703 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:43555)
0807 19:52:01.845819 (+ 1116us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:01.846225 (+ 406us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":707,"thread_start_us":458,"threads_started":1}
W20260807 19:52:01.848104 5351 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:45949 (0 consecutive failures): Network error: Failed to ping master at 127.12.155.190:45949: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
I20260807 19:52:01.848938 5354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:01.848618 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:37177)
0807 19:52:01.848767 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:01.848835 (+ 68us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":46}
I20260807 19:52:01.849772 5354 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:01.849432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:50211)
0807 19:52:01.849570 (+ 138us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:01.849642 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 19:52:01.850029 5351 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:52:01.850168 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 5081
I20260807 19:52:01.850792 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:34059
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:45949
--webserver_port=38911
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:02.202649 5356 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:02.202965 5356 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:02.203060 5356 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:02.210620 5356 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:02.210747 5356 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:02.210862 5356 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:52:02.221113 5356 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:34059
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=38911
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:02.222502 5356 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:02.223829 5356 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:02.237346 5366 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:02.237497 5363 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:02.237522 5364 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:02.238366 5356 server_base.cc:1034] running on GCE node
I20260807 19:52:02.238963 5356 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:02.239928 5356 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:02.241129 5356 hybrid_clock.cc:648] HybridClock initialized: now 1786132322241099 us; error 44 us; skew 500 ppm
I20260807 19:52:02.241470 5356 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:02 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:02.244750 5356 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:52:02.246275 5356 webserver.cc:460] Webserver started at http://127.12.155.130:38911/ using document root <none> and password file <none>
I20260807 19:52:02.246973 5356 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:02.247119 5356 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:02.252550 5356 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.002s sys 0.004s
I20260807 19:52:02.255740 5380 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:02.257047 5356 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:52:02.257225 5356 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "75cedda503084c78ad35d495e7bf3608"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "3c1244a3bb1455f373d3a3c4a20cb030"
server_key_iv: "e637cf69d8132237808669e2c4f2c25a"
server_key_version: "encryptionkey@0"
I20260807 19:52:02.258304 5356 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:02.281231 5356 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:02.285740 5356 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:02.286043 5356 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:02.287187 5356 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:02.288617 5356 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:02.288753 5356 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:02.288882 5356 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:02.288968 5356 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:02.323107 5356 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:34059
I20260807 19:52:02.323199 5572 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:34059 every 8 connection(s)
I20260807 19:52:02.324625 5356 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:52:02.329546 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.327627 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:45815)
0807 19:52:02.328375 (+ 748us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.328629 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":494,"thread_start_us":297,"threads_started":1}
W20260807 19:52:02.330286 5574 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:45949 (0 consecutive failures): Network error: Failed to ping master at 127.12.155.190:45949: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
I20260807 19:52:02.330873 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 5356
I20260807 19:52:02.331224 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.330815 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:33135)
0807 19:52:02.330997 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.331092 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
I20260807 19:52:02.331662 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:38057
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:45949
--webserver_port=46427
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43109
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:52:02.332293 5578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.331832 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:40815)
0807 19:52:02.332045 (+ 213us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.332136 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":114}
W20260807 19:52:02.332518 5574 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:52:02.679584 5581 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:02.679910 5581 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:02.680087 5581 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:02.687300 5581 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:02.687467 5581 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:02.687650 5581 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:52:02.697502 5581 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43109
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:38057
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=46427
--tserver_master_addrs=127.12.155.190:45949
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:02.698940 5581 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:02.700306 5581 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:02.714273 5594 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:02.714236 5591 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:02.714308 5592 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:02.715154 5581 server_base.cc:1034] running on GCE node
I20260807 19:52:02.715833 5581 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:02.716853 5581 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:02.718092 5581 hybrid_clock.cc:648] HybridClock initialized: now 1786132322717987 us; error 66 us; skew 500 ppm
I20260807 19:52:02.718492 5581 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:02 dist-test-slave-2p8l krb5kdc[3214](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132322, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:02.723282 5581 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:52:02.726876 5581 webserver.cc:460] Webserver started at http://127.12.155.131:46427/ using document root <none> and password file <none>
I20260807 19:52:02.727766 5581 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:02.727907 5581 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:02.735090 5581 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.003s sys 0.000s
I20260807 19:52:02.738054 5615 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:02.739537 5581 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:52:02.739718 5581 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "f6e4f01bb6d54776904626a400bad314"
format_stamp: "Formatted at 2026-08-07 19:51:56 on dist-test-slave-2p8l"
server_key: "d9aaf5c04bd3d2519d3d45fc60d10cef"
server_key_iv: "e7b73111ac30b81f9b86422168b8e156"
server_key_version: "encryptionkey@0"
I20260807 19:52:02.740819 5581 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:02.758764 5581 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:02.763391 5581 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:02.763689 5581 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:02.764735 5581 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:02.766173 5581 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:02.766287 5581 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:02.766415 5581 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:02.766507 5581 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:02.802531 5581 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:38057
I20260807 19:52:02.802583 5799 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:38057 every 8 connection(s)
I20260807 19:52:02.804322 5581 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedIPKICert.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:52:02.809600 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.807685 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:45479)
0807 19:52:02.808441 (+ 756us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.808695 (+ 254us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":496,"thread_start_us":304,"threads_started":1}
W20260807 19:52:02.810413 5800 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:45949 (0 consecutive failures): Network error: Failed to ping master at 127.12.155.190:45949: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
I20260807 19:52:02.811296 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 5581
I20260807 19:52:02.811561 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.811164 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:59593)
0807 19:52:02.811327 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.811425 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 19:52:02.812624 5804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.812166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:35619)
0807 19:52:02.812354 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.812480 (+ 126us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 19:52:02.812897 5800 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:52:02.851380 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:02.850623 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:39121)
0807 19:52:02.851076 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:02.851166 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":217,"threads_started":1}
I20260807 19:52:03.181524 5811 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:03.181914 5811 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:03.183812 5811 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
Aug 07 19:52:03 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
Aug 07 19:52:03 dist-test-slave-2p8l krb5kdc[3214](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132321, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:52:03.207257 5814 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.184502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:59537 (local address 127.12.155.130:34059)
0807 19:52:03.185871 (+ 1369us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:03.185888 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:03.185932 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:52:03.187616 (+ 1684us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:03.187626 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:03.187994 (+ 368us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:03.188279 (+ 285us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:03.190413 (+ 2134us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.191861 (+ 1448us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.193918 (+ 2057us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.194752 (+ 834us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.194969 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:03.199118 (+ 4149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:03.199130 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:03.199151 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:03.199207 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:03.202563 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:03.203595 (+ 1032us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:03.203607 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:03.203615 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:03.203826 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:03.204363 (+ 537us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:03.204368 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:03.204371 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:03.205062 (+ 691us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:03.205252 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:03.206322 (+ 1070us) server_negotiation.cc:299] Negotiation successful
0807 19:52:03.206819 (+ 497us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1193,"thread_start_us":1078,"threads_started":1}
I20260807 19:52:03.207260 5815 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.184643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51551 (local address 127.12.155.131:38057)
0807 19:52:03.186753 (+ 2110us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:03.186763 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:03.186797 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:52:03.188286 (+ 1489us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:03.188300 (+ 14us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:03.188710 (+ 410us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:03.189066 (+ 356us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:03.190546 (+ 1480us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.191798 (+ 1252us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.193938 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.194759 (+ 821us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.194982 (+ 223us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:03.199414 (+ 4432us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:03.199422 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:03.199435 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:03.199475 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:03.202886 (+ 3411us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:03.203681 (+ 795us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:03.203688 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:03.203694 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:03.203868 (+ 174us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:03.204444 (+ 576us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:03.204460 (+ 16us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:03.204464 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:03.205092 (+ 628us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:03.205312 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:03.206444 (+ 1132us) server_negotiation.cc:299] Negotiation successful
0807 19:52:03.206819 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1957,"thread_start_us":1756,"threads_started":1}
I20260807 19:52:03.207258 5812 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.184155 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38057 (local address 127.12.155.129:51551)
0807 19:52:03.186291 (+ 2136us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:03.186311 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:03.186426 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:03.189088 (+ 2662us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:03.189092 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:03.189766 (+ 674us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:03.190303 (+ 537us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:03.190322 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.192003 (+ 1681us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.192012 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:03.193730 (+ 1718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:03.193747 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.195025 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.195033 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:03.195273 (+ 240us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:03.196159 (+ 886us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:03.196179 (+ 20us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:03.199121 (+ 2942us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:03.203033 (+ 3912us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:03.203037 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:03.203040 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:03.203534 (+ 494us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:03.204015 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:03.204019 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:03.204021 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:03.204257 (+ 236us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:03.205378 (+ 1121us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:03.205383 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:03.205662 (+ 279us) client_negotiation.cc:769] Sending connection context
0807 19:52:03.206037 (+ 375us) client_negotiation.cc:240] Negotiation successful
0807 19:52:03.206692 (+ 655us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1964,"mutex_wait_us":146,"spinlock_wait_cycles":35584,"thread_start_us":1768,"threads_started":1}
I20260807 19:52:03.207259 5807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.184088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:34059 (local address 127.12.155.129:59537)
0807 19:52:03.184396 (+ 308us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:03.184436 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:03.185082 (+ 646us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:03.188477 (+ 3395us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:03.188489 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:03.189399 (+ 910us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:03.190196 (+ 797us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:03.190218 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.192069 (+ 1851us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.192076 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:03.193695 (+ 1619us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:03.193708 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:03.194980 (+ 1272us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:03.194987 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:03.195272 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:03.195968 (+ 696us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:03.195995 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:03.198768 (+ 2773us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:03.202729 (+ 3961us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:03.202740 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:03.202760 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:03.203442 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:03.203970 (+ 528us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:03.204004 (+ 34us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:03.204009 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:03.204241 (+ 232us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:03.205236 (+ 995us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:03.205245 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:03.205749 (+ 504us) client_negotiation.cc:769] Sending connection context
0807 19:52:03.206037 (+ 288us) client_negotiation.cc:240] Negotiation successful
0807 19:52:03.206846 (+ 809us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":161,"mutex_wait_us":330}
W20260807 19:52:03.210765 5170 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
W20260807 19:52:03.211098 5168 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:03.211298 5168 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625; no voters: 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314
I20260807 19:52:03.211800 5811 raft_consensus.cc:2726] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 19:52:03.333947 5817 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.333041 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:49365)
0807 19:52:03.333513 (+ 472us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:03.333703 (+ 190us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":369,"thread_start_us":224,"threads_started":1}
I20260807 19:52:03.814285 5818 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.813432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:43863)
0807 19:52:03.813859 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:03.813974 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":316,"thread_start_us":207,"threads_started":1}
I20260807 19:52:03.853128 5819 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:03.852344 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:47667)
0807 19:52:03.852789 (+ 445us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:03.852876 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":222,"threads_started":1}
I20260807 19:52:04.335749 5820 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:04.334866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:50807)
0807 19:52:04.335395 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:04.335496 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":394,"thread_start_us":252,"threads_started":1}
I20260807 19:52:04.815820 5821 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:04.815127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:56899)
0807 19:52:04.815555 (+ 428us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:04.815631 (+ 76us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":334,"thread_start_us":223,"threads_started":1}
I20260807 19:52:04.855010 5822 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:04.854169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:48837)
0807 19:52:04.854725 (+ 556us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:04.854813 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":423,"thread_start_us":232,"threads_started":1}
I20260807 19:52:05.337442 5823 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:05.336600 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:32865)
0807 19:52:05.337170 (+ 570us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:05.337254 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":420,"thread_start_us":314,"threads_started":1}
I20260807 19:52:05.402595 5825 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:05.402827 5825 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:05.403753 5825 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
W20260807 19:52:05.404568 5170 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
W20260807 19:52:05.404759 5168 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:05.404907 5168 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625; no voters: 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314
I20260807 19:52:05.405170 5825 raft_consensus.cc:2726] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 19:52:05.817469 5828 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:05.816757 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:38793)
0807 19:52:05.817226 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:05.817311 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":367,"thread_start_us":257,"threads_started":1}
I20260807 19:52:05.857113 5832 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:05.856169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:33467)
0807 19:52:05.856790 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:05.856931 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":490,"thread_start_us":269,"threads_started":1}
I20260807 19:52:06.339008 5833 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:06.338316 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:40151)
0807 19:52:06.338750 (+ 434us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:06.338828 (+ 78us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":339,"thread_start_us":203,"threads_started":1}
I20260807 19:52:06.819121 5836 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:06.818407 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:42615)
0807 19:52:06.818860 (+ 453us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:06.818950 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":221,"threads_started":1}
I20260807 19:52:06.859397 5837 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:06.858609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:39349)
0807 19:52:06.859101 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:06.859206 (+ 105us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":389,"thread_start_us":230,"threads_started":1}
I20260807 19:52:07.340579 5838 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:07.339873 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:38205)
0807 19:52:07.340329 (+ 456us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:07.340411 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":247,"threads_started":1}
I20260807 19:52:07.820760 5839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:07.820108 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:54925)
0807 19:52:07.820526 (+ 418us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:07.820609 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":323,"thread_start_us":225,"threads_started":1}
I20260807 19:52:07.860975 5840 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:07.860303 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:51479)
0807 19:52:07.860730 (+ 427us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:07.860811 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":327,"thread_start_us":224,"threads_started":1}
I20260807 19:52:08.005416 5841 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:08.005728 5841 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:08.006484 5841 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
W20260807 19:52:08.007527 5168 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
W20260807 19:52:08.007807 5170 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:08.007946 5170 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625; no voters: 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314
I20260807 19:52:08.008237 5841 raft_consensus.cc:2726] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 19:52:08.342262 5844 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:08.341423 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:42505)
0807 19:52:08.341936 (+ 513us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:08.342015 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":412,"thread_start_us":291,"threads_started":1}
I20260807 19:52:08.822562 5846 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:08.821713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:54045)
0807 19:52:08.822301 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:08.822383 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":486,"thread_start_us":304,"threads_started":1}
I20260807 19:52:08.862907 5847 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:08.862030 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:33761)
0807 19:52:08.862573 (+ 543us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:08.862669 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":440,"thread_start_us":230,"threads_started":1}
I20260807 19:52:09.343935 5848 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:09.343194 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:39873)
0807 19:52:09.343663 (+ 469us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:09.343749 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":211,"threads_started":1}
I20260807 19:52:09.824436 5850 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:09.823563 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:33373)
0807 19:52:09.824148 (+ 585us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:09.824235 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":476,"thread_start_us":287,"threads_started":1}
I20260807 19:52:09.864533 5854 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:09.863812 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:52891)
0807 19:52:09.864272 (+ 460us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:09.864355 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":344,"thread_start_us":226,"threads_started":1}
I20260807 19:52:10.345736 5855 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:10.344879 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:50041)
0807 19:52:10.345442 (+ 563us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:10.345526 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":454,"thread_start_us":334,"threads_started":1}
I20260807 19:52:10.826371 5856 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:10.825520 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:37851)
0807 19:52:10.826037 (+ 517us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:10.826172 (+ 135us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":395,"thread_start_us":294,"threads_started":1}
I20260807 19:52:10.866348 5859 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:10.865461 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:42669)
0807 19:52:10.865961 (+ 500us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:10.866150 (+ 189us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":386,"thread_start_us":269,"threads_started":1}
I20260807 19:52:11.347424 5862 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:11.346696 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:45389)
0807 19:52:11.347170 (+ 474us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:11.347263 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":374,"thread_start_us":232,"threads_started":1}
I20260807 19:52:11.828296 5865 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:11.827488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:45857)
0807 19:52:11.828036 (+ 548us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:11.828128 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":424,"thread_start_us":258,"threads_started":1}
I20260807 19:52:11.868098 5867 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:11.867370 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:39279)
0807 19:52:11.867846 (+ 476us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:11.867930 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":249,"threads_started":1}
I20260807 19:52:12.349169 5868 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:12.348355 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:52389)
0807 19:52:12.348880 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:12.348979 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":425,"thread_start_us":313,"threads_started":1}
I20260807 19:52:12.830176 5870 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:12.829362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:58573)
0807 19:52:12.829846 (+ 484us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:12.829936 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":261,"threads_started":1}
I20260807 19:52:12.830824 5871 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:12.831028 5871 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:12.831779 5871 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
W20260807 19:52:12.832811 5170 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
W20260807 19:52:12.833017 5168 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:12.833214 5168 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625; no voters: 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314
I20260807 19:52:12.833506 5871 raft_consensus.cc:2726] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 19:52:12.870258 5874 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:12.869211 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:48135)
0807 19:52:12.869832 (+ 621us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:12.869984 (+ 152us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":270,"threads_started":1}
I20260807 19:52:13.350823 5876 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:13.350102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:42283)
0807 19:52:13.350572 (+ 470us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:13.350662 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":355,"thread_start_us":217,"threads_started":1}
I20260807 19:52:13.832052 5877 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:13.831286 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:34855)
0807 19:52:13.831811 (+ 525us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:13.831891 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":273,"threads_started":1}
I20260807 19:52:13.871948 5878 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:13.871196 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:60773)
0807 19:52:13.871673 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:13.871768 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":251,"threads_started":1}
I20260807 19:52:14.352415 5879 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:14.351688 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:39015)
0807 19:52:14.352143 (+ 455us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:14.352227 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":348,"thread_start_us":236,"threads_started":1}
I20260807 19:52:14.833837 5880 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:14.833024 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:50097)
0807 19:52:14.833516 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:14.833653 (+ 137us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":385,"thread_start_us":248,"threads_started":1}
I20260807 19:52:14.873600 5882 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:14.872851 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:43319)
0807 19:52:14.873300 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:14.873388 (+ 88us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":352,"thread_start_us":238,"threads_started":1}
I20260807 19:52:15.354586 5883 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:15.353622 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:57099)
0807 19:52:15.354250 (+ 628us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:15.354350 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":514,"thread_start_us":300,"threads_started":1}
I20260807 19:52:15.373107 5885 raft_consensus.cc:482] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:15.373333 5885 raft_consensus.cc:504] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f6e4f01bb6d54776904626a400bad314" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38057 } } peers { permanent_uuid: "086e5dfe99fd45d8a0b36f361bd65625" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34755 } } peers { permanent_uuid: "75cedda503084c78ad35d495e7bf3608" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 34059 } }
I20260807 19:52:15.374655 5885 leader_election.cc:288] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057), 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059)
W20260807 19:52:15.375180 5170 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer f6e4f01bb6d54776904626a400bad314 (127.12.155.131:38057): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
W20260807 19:52:15.375504 5168 leader_election.cc:341] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Tablet error from VoteRequest() call to peer 75cedda503084c78ad35d495e7bf3608 (127.12.155.130:34059): Not found: Tablet not found: 16fefd0dd02a46baab4255102d796e1c
I20260807 19:52:15.375658 5168 leader_election.cc:302] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 086e5dfe99fd45d8a0b36f361bd65625; no voters: 75cedda503084c78ad35d495e7bf3608, f6e4f01bb6d54776904626a400bad314
I20260807 19:52:15.375975 5885 raft_consensus.cc:2726] T 16fefd0dd02a46baab4255102d796e1c P 086e5dfe99fd45d8a0b36f361bd65625 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20260807 19:52:15.835633 5886 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:15.834838 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:40229)
0807 19:52:15.835311 (+ 473us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:15.835410 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":364,"thread_start_us":238,"threads_started":1}
I20260807 19:52:15.875514 5887 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:15.874613 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:36087)
0807 19:52:15.875132 (+ 519us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:15.875243 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":416,"thread_start_us":301,"threads_started":1}
I20260807 19:52:16.356254 5888 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:16.355466 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:60543)
0807 19:52:16.355946 (+ 480us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:16.356037 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":381,"thread_start_us":253,"threads_started":1}
I20260807 19:52:16.837365 5892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:16.836602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:51767)
0807 19:52:16.837077 (+ 475us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:16.837166 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":372,"thread_start_us":238,"threads_started":1}
I20260807 19:52:16.877703 5893 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:16.876766 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.129:47727)
0807 19:52:16.877370 (+ 604us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:16.877516 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":474,"thread_start_us":343,"threads_started":1}
I20260807 19:52:17.358194 5895 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:17.357395 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.130:57631)
0807 19:52:17.357852 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:17.357950 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":229,"threads_started":1}
I20260807 19:52:17.818773 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 5081
I20260807 19:52:17.835508 5896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:17.820109 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60676 (local address 127.12.155.129:34755)
0807 19:52:17.821152 (+ 1043us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:17.821165 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:17.821208 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:52:17.821304 (+ 96us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:17.821316 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:17.821668 (+ 352us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:17.821864 (+ 196us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:17.823361 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:17.824435 (+ 1074us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:17.825753 (+ 1318us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:17.826423 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:17.826572 (+ 149us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:17.829372 (+ 2800us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:17.829384 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:17.829399 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:17.829434 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:17.832388 (+ 2954us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:17.833204 (+ 816us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:17.833212 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:17.833215 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:17.833350 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:17.833772 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:17.833777 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:17.833782 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:17.834249 (+ 467us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:17.834594 (+ 345us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:17.834888 (+ 294us) server_negotiation.cc:299] Negotiation successful
0807 19:52:17.835178 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":420,"threads_started":1}
I20260807 19:52:17.836808 5341 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:17.839816 5898 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:17.838839 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:45949 (local address 127.12.155.131:32963)
0807 19:52:17.839418 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:17.839590 (+ 172us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:45949: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":430,"thread_start_us":296,"threads_started":1}
I20260807 19:52:17.928174 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 5081
I20260807 19:52:17.955206 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 5356
I20260807 19:52:17.969723 5903 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:17.956087 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47990 (local address 127.12.155.130:34059)
0807 19:52:17.956603 (+ 516us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:17.956607 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:17.956624 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:52:17.956684 (+ 60us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:17.956688 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:17.956752 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:17.956848 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:17.958434 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:17.959242 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:17.960518 (+ 1276us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:17.960955 (+ 437us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:17.961097 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:17.964141 (+ 3044us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:17.964147 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:17.964150 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:17.964189 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:17.966957 (+ 2768us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:17.967670 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:17.967677 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:17.967681 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:17.967815 (+ 134us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:17.968205 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:17.968210 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:17.968214 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:17.968496 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:17.968780 (+ 284us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:17.969097 (+ 317us) server_negotiation.cc:299] Negotiation successful
0807 19:52:17.969337 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":413,"thread_start_us":273,"threads_started":1}
I20260807 19:52:17.970685 5565 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:18.056252 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 5356
I20260807 19:52:18.082525 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 5581
I20260807 19:52:18.097126 5908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:18.083502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37294 (local address 127.12.155.131:38057)
0807 19:52:18.084129 (+ 627us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:18.084133 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:18.084150 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:52:18.084206 (+ 56us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:18.084210 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:18.084277 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:18.084530 (+ 253us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:18.086039 (+ 1509us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:18.087038 (+ 999us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:18.088321 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:18.088753 (+ 432us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:18.088900 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:18.091779 (+ 2879us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:18.091784 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:18.091788 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:18.091820 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:18.094467 (+ 2647us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:18.095123 (+ 656us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:18.095129 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:18.095135 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:18.095267 (+ 132us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:18.095652 (+ 385us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:18.095657 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:18.095662 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:18.095927 (+ 265us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:18.096212 (+ 285us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:18.096519 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 19:52:18.096752 (+ 233us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":505,"thread_start_us":303,"threads_started":1}
I20260807 19:52:18.097985 5792 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:18.183219 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 5581
2026-08-07T19:52:18Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedIPKICert (25120 ms)
[ RUN ] SecurityITest.TestEnableAndDisableEncryptedTSK
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:52:18 dist-test-slave-2p8l krb5kdc[5913](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:52:18 dist-test-slave-2p8l krb5kdc[5913](info): set up 2 sockets
Aug 07 19:52:18 dist-test-slave-2p8l krb5kdc[5913](info): commencing operation
krb5kdc: starting...
W20260807 19:52:19.594198 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.362s user 0.002s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:52:19 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:52:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:52:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:52:19.898535 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43061
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:20.237804 5935 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:20.238190 5935 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:20.238376 5935 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:20.245639 5935 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 19:52:20.245827 5935 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 19:52:20.245918 5935 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 19:52:20.246006 5935 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:52:20.246109 5935 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:20.246245 5935 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:20.246338 5935 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:52:20.246423 5935 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:52:20.256383 5935 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:20.257830 5935 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:20.259248 5935 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:20.272156 5953 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:20.272198 5949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:20.272257 5948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:20.273118 5935 server_base.cc:1034] running on GCE node
I20260807 19:52:20.273923 5935 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:20.275345 5935 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:20.276575 5935 hybrid_clock.cc:648] HybridClock initialized: now 1786132340276507 us; error 39 us; skew 500 ppm
I20260807 19:52:20.276937 5935 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:20 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132340, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:20.280309 5935 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:52:20.281864 5935 webserver.cc:460] Webserver started at http://127.12.155.190:42249/ using document root <none> and password file <none>
I20260807 19:52:20.282658 5935 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:20.282793 5935 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:20.283133 5935 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:52:20.286198 5935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "7b0110de43704a04b4001484da807d5c"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "f0d6300b4bce2f6d9d04bbd6a2e5cfa4"
server_key_iv: "3bcd366b33c3b8fa903a254466f47c45"
server_key_version: "encryptionkey@0"
I20260807 19:52:20.286999 5935 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "7b0110de43704a04b4001484da807d5c"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "f0d6300b4bce2f6d9d04bbd6a2e5cfa4"
server_key_iv: "3bcd366b33c3b8fa903a254466f47c45"
server_key_version: "encryptionkey@0"
I20260807 19:52:20.292285 5935 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:52:20.295831 5962 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:20.297101 5935 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:52:20.297309 5935 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "7b0110de43704a04b4001484da807d5c"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "f0d6300b4bce2f6d9d04bbd6a2e5cfa4"
server_key_iv: "3bcd366b33c3b8fa903a254466f47c45"
server_key_version: "encryptionkey@0"
I20260807 19:52:20.297542 5935 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:20.312666 5935 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:20.316620 5935 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:20.316915 5935 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:20.337690 5935 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43061
I20260807 19:52:20.337729 6048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43061 every 8 connection(s)
I20260807 19:52:20.339186 5935 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:52:20.343428 6049 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:20.348081 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 5935
I20260807 19:52:20.348356 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:52:20.349232 12910 external_mini_cluster.cc:1428] Setting key dafc1a2161e40547b72e91fc88cfe58e
I20260807 19:52:20.355883 6049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap starting.
I20260807 19:52:20.359736 6049 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:20.361048 6049 log.cc:824] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:20.363934 6049 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: No bootstrap required, opened a new log
Aug 07 19:52:20 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:20.374727 6049 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:20.375175 6052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:20.351463 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53412 (local address 127.12.155.190:43061)
0807 19:52:20.352318 (+ 855us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:20.352333 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:20.352375 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:52:20.354272 (+ 1897us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:20.354297 (+ 25us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:20.354699 (+ 402us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:20.355032 (+ 333us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:20.357046 (+ 2014us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:20.358441 (+ 1395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:20.360505 (+ 2064us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:20.361176 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:20.361368 (+ 192us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:20.365899 (+ 4531us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:20.365909 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:20.365928 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:20.365981 (+ 53us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:20.370301 (+ 4320us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:20.371088 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:20.371097 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:20.371106 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:20.371318 (+ 212us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:20.371747 (+ 429us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:20.371752 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:20.371755 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:20.372544 (+ 789us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:20.372879 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:20.373279 (+ 400us) server_negotiation.cc:299] Negotiation successful
0807 19:52:20.373765 (+ 486us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":629,"thread_start_us":421,"threads_started":1}
I20260807 19:52:20.375228 6049 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:20.375324 6049 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b0110de43704a04b4001484da807d5c, State: Initialized, Role: FOLLOWER
I20260807 19:52:20.375941 6049 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:20.376219 6049 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:52:20.376382 6049 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:52:20.376585 6049 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:20.379612 6049 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:20.380213 6049 leader_election.cc:302] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b0110de43704a04b4001484da807d5c; no voters:
I20260807 19:52:20.380944 6049 leader_election.cc:288] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:52:20.381002 6054 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:52:20.381778 6054 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 LEADER]: Becoming Leader. State: Replica: 7b0110de43704a04b4001484da807d5c, State: Running, Role: LEADER
I20260807 19:52:20.382417 6054 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:20.383124 6049 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:52:20.385810 6056 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7b0110de43704a04b4001484da807d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } } }
I20260807 19:52:20.385711 6057 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0110de43704a04b4001484da807d5c. Latest consensus state: current_term: 1 leader_uuid: "7b0110de43704a04b4001484da807d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } } }
I20260807 19:52:20.386795 6057 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: This master's current role is: LEADER
I20260807 19:52:20.386801 6056 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: This master's current role is: LEADER
I20260807 19:52:20.387738 6074 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:52:20.394712 6074 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:52:20.404918 6074 catalog_manager.cc:1347] Generated new cluster ID: 4db9700a9ec04ebd981575be2303facb
I20260807 19:52:20.405050 6074 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:52:20.423975 6074 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:52:20.425318 6074 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:52:20.430720 6074 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Generated new TSK 0
I20260807 19:52:20.431532 6074 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:52:20.509985 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43061
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:20.858098 6092 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:20.858382 6092 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:20.858547 6092 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:20.866045 6092 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:20.866252 6092 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:20.866429 6092 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:52:20.876690 6092 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:20.878424 6092 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:20.879910 6092 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:20.894243 6099 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:20.894300 6098 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:20.894266 6102 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:20.895449 6092 server_base.cc:1034] running on GCE node
I20260807 19:52:20.896059 6092 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:20.896965 6092 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:20.898162 6092 hybrid_clock.cc:648] HybridClock initialized: now 1786132340898097 us; error 48 us; skew 500 ppm
I20260807 19:52:20.898487 6092 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:20 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132340, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:20.901881 6092 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:52:20.903406 6092 webserver.cc:460] Webserver started at http://127.12.155.129:46087/ using document root <none> and password file <none>
I20260807 19:52:20.904102 6092 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:20.904254 6092 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:20.904613 6092 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:52:20.907748 6092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "67b99618179f4586a49e1f32d21e7187"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "cf0b8c0880fe76934827a455b7ad70d1"
server_key_iv: "63ec50e90ab9589ea468bfcfcf56b1a3"
server_key_version: "encryptionkey@0"
I20260807 19:52:20.908519 6092 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "67b99618179f4586a49e1f32d21e7187"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "cf0b8c0880fe76934827a455b7ad70d1"
server_key_iv: "63ec50e90ab9589ea468bfcfcf56b1a3"
server_key_version: "encryptionkey@0"
I20260807 19:52:20.913612 6092 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:52:20.917110 6113 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:20.918502 6092 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:52:20.918720 6092 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "67b99618179f4586a49e1f32d21e7187"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "cf0b8c0880fe76934827a455b7ad70d1"
server_key_iv: "63ec50e90ab9589ea468bfcfcf56b1a3"
server_key_version: "encryptionkey@0"
I20260807 19:52:20.918918 6092 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:20.933153 6092 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:20.937695 6092 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:20.938019 6092 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:20.939069 6092 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:20.940658 6092 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:20.940766 6092 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:20.940917 6092 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:20.940996 6092 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:20.975595 6092 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34947
I20260807 19:52:20.975606 6300 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34947 every 8 connection(s)
I20260807 19:52:20.976948 6092 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:52:20.981494 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 6092
I20260807 19:52:20.981716 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:52:20.982457 12910 external_mini_cluster.cc:1428] Setting key e521a622aad45cb9620d8e7f9d875afb
Aug 07 19:52:20 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132340, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:20.998634 6304 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:20.979546 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:59915 (local address 127.12.155.190:43061)
0807 19:52:20.980030 (+ 484us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:20.980035 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:20.980947 (+ 912us) server_negotiation.cc:407] Connection header received
0807 19:52:20.983256 (+ 2309us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:20.983263 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:20.983366 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:20.983509 (+ 143us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:20.985271 (+ 1762us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:20.986174 (+ 903us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:20.988129 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:20.988592 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:20.988746 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:20.992474 (+ 3728us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:20.992479 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:20.992483 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:20.992514 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:20.995299 (+ 2785us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:20.996046 (+ 747us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:20.996051 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:20.996055 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:20.996181 (+ 126us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:20.996629 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:20.996635 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:20.996638 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:20.996990 (+ 352us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:20.997144 (+ 154us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:20.997869 (+ 725us) server_negotiation.cc:299] Negotiation successful
0807 19:52:20.998153 (+ 284us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":263,"threads_started":1}
I20260807 19:52:20.999296 6305 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:20.979955 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:59915)
0807 19:52:20.980757 (+ 802us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:20.980802 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:20.982959 (+ 2157us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:20.983793 (+ 834us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:20.983802 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:20.984483 (+ 681us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:20.985082 (+ 599us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:20.985101 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:20.986388 (+ 1287us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:20.986393 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:20.987960 (+ 1567us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:20.987974 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:20.988870 (+ 896us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:20.988881 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:20.989166 (+ 285us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:20.989950 (+ 784us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:20.989973 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:20.992251 (+ 2278us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:20.995442 (+ 3191us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:20.995452 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:20.995469 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:20.995908 (+ 439us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:20.996299 (+ 391us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:20.996303 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:20.996307 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:20.996509 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:20.997115 (+ 606us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:20.997121 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:20.997440 (+ 319us) client_negotiation.cc:769] Sending connection context
0807 19:52:20.997723 (+ 283us) client_negotiation.cc:240] Negotiation successful
0807 19:52:20.998198 (+ 475us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"thread_start_us":330,"threads_started":1}
I20260807 19:52:21.001019 6302 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43061
I20260807 19:52:21.001356 6302 heartbeater.cc:464] Registering TS with master...
I20260807 19:52:21.002317 6302 heartbeater.cc:511] Master 127.12.155.190:43061 requested a full tablet report, sending...
I20260807 19:52:21.004709 5985 ts_manager.cc:194] Registered new tserver with Master: 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947)
I20260807 19:52:21.006379 5985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:59915
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:52:21.050138 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43061
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:21.403090 6308 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:21.403380 6308 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:21.403486 6308 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:21.410975 6308 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:21.411087 6308 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:21.411206 6308 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:52:21.421221 6308 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:21.422528 6308 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:21.424011 6308 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:21.437433 6316 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:21.437469 6314 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:21.437565 6320 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:21.438374 6308 server_base.cc:1034] running on GCE node
I20260807 19:52:21.438987 6308 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:21.439826 6308 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:21.441080 6308 hybrid_clock.cc:648] HybridClock initialized: now 1786132341441012 us; error 58 us; skew 500 ppm
I20260807 19:52:21.441399 6308 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:21 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132341, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:21.450482 6308 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:52:21.451990 6308 webserver.cc:460] Webserver started at http://127.12.155.130:44225/ using document root <none> and password file <none>
I20260807 19:52:21.452694 6308 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:21.452847 6308 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:21.453182 6308 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:52:21.456230 6308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "0e7a07e94fa94e85bc8cc05429895f1d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "696aa4c7b175eb79a36603f44a9b3de4"
server_key_iv: "44fe4dbd73929807d715bffd682bf287"
server_key_version: "encryptionkey@0"
I20260807 19:52:21.457050 6308 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "0e7a07e94fa94e85bc8cc05429895f1d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "696aa4c7b175eb79a36603f44a9b3de4"
server_key_iv: "44fe4dbd73929807d715bffd682bf287"
server_key_version: "encryptionkey@0"
I20260807 19:52:21.462502 6308 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.003s
I20260807 19:52:21.466347 6329 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:21.467727 6308 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:52:21.467938 6308 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "0e7a07e94fa94e85bc8cc05429895f1d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "696aa4c7b175eb79a36603f44a9b3de4"
server_key_iv: "44fe4dbd73929807d715bffd682bf287"
server_key_version: "encryptionkey@0"
I20260807 19:52:21.468185 6308 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:21.496690 6308 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:21.501605 6308 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:21.501936 6308 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:21.502930 6308 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:21.504274 6308 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:21.504377 6308 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:21.504562 6308 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:21.504643 6308 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:21.539250 6308 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:44957
I20260807 19:52:21.539345 6505 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:44957 every 8 connection(s)
I20260807 19:52:21.540601 6308 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:52:21.550823 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 6308
I20260807 19:52:21.551041 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:52:21.551537 12910 external_mini_cluster.cc:1428] Setting key 43408eed9b5fc153894c29de60b117ce
Aug 07 19:52:21 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132341, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:21.562321 6509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:21.543283 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:48567 (local address 127.12.155.190:43061)
0807 19:52:21.543790 (+ 507us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:21.543795 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:21.544612 (+ 817us) server_negotiation.cc:407] Connection header received
0807 19:52:21.546504 (+ 1892us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:21.546510 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:21.546604 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:21.546737 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:21.548284 (+ 1547us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:21.549015 (+ 731us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:21.550851 (+ 1836us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:21.551417 (+ 566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:21.551529 (+ 112us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:21.555919 (+ 4390us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:21.555925 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:21.555928 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:21.555963 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:21.558859 (+ 2896us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:21.559843 (+ 984us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:21.559847 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:21.559849 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:21.559979 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:21.560478 (+ 499us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:21.560481 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:21.560483 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:21.560752 (+ 269us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:21.560869 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:21.561801 (+ 932us) server_negotiation.cc:299] Negotiation successful
0807 19:52:21.561974 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":406,"thread_start_us":284,"threads_started":1}
I20260807 19:52:21.563896 6516 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:21.543713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:48567)
0807 19:52:21.544433 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:21.544485 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:21.546223 (+ 1738us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:21.546982 (+ 759us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:21.546991 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:21.547518 (+ 527us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:21.548090 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:21.548107 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:21.549197 (+ 1090us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:21.549201 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:21.550651 (+ 1450us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:21.550669 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:21.551670 (+ 1001us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:21.551678 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:21.551988 (+ 310us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:21.552807 (+ 819us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:21.552831 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:21.555659 (+ 2828us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:21.559009 (+ 3350us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:21.559021 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:21.559041 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:21.559706 (+ 665us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:21.560090 (+ 384us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:21.560097 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:21.560104 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:21.560357 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:21.560884 (+ 527us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:21.560895 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:21.561381 (+ 486us) client_negotiation.cc:769] Sending connection context
0807 19:52:21.561715 (+ 334us) client_negotiation.cc:240] Negotiation successful
0807 19:52:21.562334 (+ 619us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":503,"thread_start_us":287,"threads_started":1}
I20260807 19:52:21.565553 6506 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43061
I20260807 19:52:21.565882 6506 heartbeater.cc:464] Registering TS with master...
I20260807 19:52:21.566670 6506 heartbeater.cc:511] Master 127.12.155.190:43061 requested a full tablet report, sending...
I20260807 19:52:21.568280 5985 ts_manager.cc:194] Registered new tserver with Master: 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130:44957)
I20260807 19:52:21.569137 5985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:48567
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:52:21.617825 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43061
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:21.959362 6523 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:21.959714 6523 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:21.959890 6523 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:21.967350 6523 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:21.967509 6523 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:21.967700 6523 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:52:21.977690 6523 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:21.979123 6523 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:21.980458 6523 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:21.994392 6535 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:21.994491 6534 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:21.995138 6538 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:21.995229 6523 server_base.cc:1034] running on GCE node
I20260807 19:52:21.995869 6523 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:21.996909 6523 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:21.998172 6523 hybrid_clock.cc:648] HybridClock initialized: now 1786132341998107 us; error 58 us; skew 500 ppm
I20260807 19:52:21.998495 6523 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:21 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132341, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:22.001706 6523 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:52:22.003245 6523 webserver.cc:460] Webserver started at http://127.12.155.131:36949/ using document root <none> and password file <none>
I20260807 19:52:22.003870 6523 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:22.003970 6523 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:22.004242 6523 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:52:22.007387 6523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "8bae997f34414435a0d90c5bcc16ba7d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "0e0ccbec5ab2f7fa5c6dcdc094094226"
server_key_iv: "06d2eded752c1330080434a1c188c701"
server_key_version: "encryptionkey@0"
I20260807 19:52:22.008152 6523 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "8bae997f34414435a0d90c5bcc16ba7d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "0e0ccbec5ab2f7fa5c6dcdc094094226"
server_key_iv: "06d2eded752c1330080434a1c188c701"
server_key_version: "encryptionkey@0"
I20260807 19:52:22.010301 6302 heartbeater.cc:503] Master 127.12.155.190:43061 was elected leader, sending a full tablet report...
I20260807 19:52:22.013850 6523 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:52:22.017271 6550 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:22.018622 6523 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:52:22.018821 6523 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "8bae997f34414435a0d90c5bcc16ba7d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "0e0ccbec5ab2f7fa5c6dcdc094094226"
server_key_iv: "06d2eded752c1330080434a1c188c701"
server_key_version: "encryptionkey@0"
I20260807 19:52:22.019021 6523 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:22.041810 6523 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:22.046015 6523 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:22.046392 6523 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:22.047480 6523 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:22.048856 6523 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:22.048931 6523 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:22.049100 6523 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:22.049158 6523 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:22.084779 6523 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:35765
I20260807 19:52:22.084822 6715 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:35765 every 8 connection(s)
I20260807 19:52:22.086187 6523 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:52:22.096257 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 6523
I20260807 19:52:22.096478 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:52:22.096999 12910 external_mini_cluster.cc:1428] Setting key 2426e1c67098ddd07647e7eabe23680c
Aug 07 19:52:22 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132341, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:22.106210 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.088893 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:46281 (local address 127.12.155.190:43061)
0807 19:52:22.089309 (+ 416us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.089313 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.090442 (+ 1129us) server_negotiation.cc:407] Connection header received
0807 19:52:22.092197 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.092202 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.092281 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.092381 (+ 100us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:22.093775 (+ 1394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.094636 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.096228 (+ 1592us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.096739 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.096835 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.100837 (+ 4002us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:22.100842 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:22.100845 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:22.100876 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:22.103562 (+ 2686us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.104235 (+ 673us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.104238 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.104241 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.104359 (+ 118us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.104749 (+ 390us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.104753 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.104755 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.105001 (+ 246us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:22.105138 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.105725 (+ 587us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.105878 (+ 153us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":311,"thread_start_us":199,"threads_started":1}
I20260807 19:52:22.107131 6725 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.089448 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:46281)
0807 19:52:22.090243 (+ 795us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:22.090300 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:22.091933 (+ 1633us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:22.092577 (+ 644us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:22.092585 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:22.093064 (+ 479us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:22.093613 (+ 549us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.093630 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.094765 (+ 1135us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.094769 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.096073 (+ 1304us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.096089 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.096966 (+ 877us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.096973 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.097289 (+ 316us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.098103 (+ 814us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:22.098138 (+ 35us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:22.100662 (+ 2524us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:22.103694 (+ 3032us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:22.103701 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:22.103712 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:22.104126 (+ 414us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:22.104462 (+ 336us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:22.104466 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:22.104468 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:22.104631 (+ 163us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:22.105125 (+ 494us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:22.105131 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:22.105415 (+ 284us) client_negotiation.cc:769] Sending connection context
0807 19:52:22.105635 (+ 220us) client_negotiation.cc:240] Negotiation successful
0807 19:52:22.106010 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":274,"threads_started":1}
I20260807 19:52:22.108433 6716 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43061
I20260807 19:52:22.108696 6716 heartbeater.cc:464] Registering TS with master...
I20260807 19:52:22.109349 6716 heartbeater.cc:511] Master 127.12.155.190:43061 requested a full tablet report, sending...
I20260807 19:52:22.110750 5985 ts_manager.cc:194] Registered new tserver with Master: 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131:35765)
I20260807 19:52:22.111572 5985 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:46281
I20260807 19:52:22.112831 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:52:22.131296 6720 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.118506 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53422 (local address 127.12.155.190:43061)
0807 19:52:22.118706 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.118710 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.119093 (+ 383us) server_negotiation.cc:407] Connection header received
0807 19:52:22.119211 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.119214 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.119272 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.119354 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:22.120846 (+ 1492us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.121595 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.123147 (+ 1552us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.123653 (+ 506us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.123764 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.126257 (+ 2493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:22.126261 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:22.126265 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:22.126293 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:22.128716 (+ 2423us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.129358 (+ 642us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.129362 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.129364 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.129484 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.129903 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.129906 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.129908 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.130352 (+ 444us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:22.130535 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.130880 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.131067 (+ 187us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 19:52:22.135689 5985 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53422:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:52:22.142742 5985 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:52:22.168322 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.154909 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57180 (local address 127.12.155.130:44957)
0807 19:52:22.156150 (+ 1241us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.156162 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.156643 (+ 481us) server_negotiation.cc:407] Connection header received
0807 19:52:22.156983 (+ 340us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.156994 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.157277 (+ 283us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.157504 (+ 227us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:22.158792 (+ 1288us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.161618 (+ 2826us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.165095 (+ 3477us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.166676 (+ 1581us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.166849 (+ 173us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.167073 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.167771 (+ 698us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.167975 (+ 204us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1063,"thread_start_us":922,"threads_started":1}
I20260807 19:52:22.168416 6738 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.154695 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:44957 (local address 127.0.0.1:57180)
0807 19:52:22.156483 (+ 1788us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:22.156521 (+ 38us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:22.156736 (+ 215us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:22.157894 (+ 1158us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:22.157906 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:22.157949 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:22.158514 (+ 565us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.158532 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.161828 (+ 3296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.161837 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.164882 (+ 3045us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.164895 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.167230 (+ 2335us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.167238 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.167470 (+ 232us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.167548 (+ 78us) client_negotiation.cc:769] Sending connection context
0807 19:52:22.167699 (+ 151us) client_negotiation.cc:240] Negotiation successful
0807 19:52:22.167916 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1601,"mutex_wait_us":1,"thread_start_us":1463,"threads_started":1}
I20260807 19:52:22.171262 6740 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.156901 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35765 (local address 127.0.0.1:39330)
0807 19:52:22.157489 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:22.157511 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:22.157643 (+ 132us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:22.164328 (+ 6685us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:22.164333 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:22.164360 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:22.164813 (+ 453us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.164821 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.166347 (+ 1526us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.166352 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.168609 (+ 2257us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.168634 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.170433 (+ 1799us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.170440 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.170614 (+ 174us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.170658 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 19:52:22.170766 (+ 108us) client_negotiation.cc:240] Negotiation successful
0807 19:52:22.170907 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":452,"thread_start_us":323,"threads_started":1}
I20260807 19:52:22.171394 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.157224 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39330 (local address 127.12.155.131:35765)
0807 19:52:22.163685 (+ 6461us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.163693 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.163725 (+ 32us) server_negotiation.cc:407] Connection header received
0807 19:52:22.163812 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.163820 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.164100 (+ 280us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.164303 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:22.165008 (+ 705us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.166180 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.168825 (+ 2645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.170210 (+ 1385us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.170423 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.170593 (+ 170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.170827 (+ 234us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.171018 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6279,"thread_start_us":6116,"threads_started":1}
I20260807 19:52:22.172842 6745 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.158134 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34947 (local address 127.0.0.1:45056)
0807 19:52:22.162524 (+ 4390us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:22.162548 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:22.162727 (+ 179us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:22.163704 (+ 977us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:22.163709 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:22.163735 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:22.164330 (+ 595us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.164340 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.166876 (+ 2536us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.166881 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.169136 (+ 2255us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.169151 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.171978 (+ 2827us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.171986 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.172174 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.172206 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:52:22.172349 (+ 143us) client_negotiation.cc:240] Negotiation successful
0807 19:52:22.172478 (+ 129us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4191,"thread_start_us":3986,"threads_started":1}
I20260807 19:52:22.173586 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.157841 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45056 (local address 127.12.155.129:34947)
0807 19:52:22.160146 (+ 2305us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.160157 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.162922 (+ 2765us) server_negotiation.cc:407] Connection header received
0807 19:52:22.163076 (+ 154us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.163089 (+ 13us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.163414 (+ 325us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.163718 (+ 304us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:22.165019 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.166676 (+ 1657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.169313 (+ 2637us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.170876 (+ 1563us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.171073 (+ 197us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.171251 (+ 178us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.173149 (+ 1898us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.173285 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2085,"thread_start_us":1920,"threads_started":1}
I20260807 19:52:22.173060 6405 tablet_service.cc:1467] Processing CreateTablet for tablet 29c170d9998d4adb83e4160604c26bf3 (DEFAULT_TABLE table=test-table [id=a72a2b08c6d54bdc88120a8c5a0a725b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:52:22.174746 6405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c170d9998d4adb83e4160604c26bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:22.175580 6620 tablet_service.cc:1467] Processing CreateTablet for tablet 29c170d9998d4adb83e4160604c26bf3 (DEFAULT_TABLE table=test-table [id=a72a2b08c6d54bdc88120a8c5a0a725b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:52:22.177129 6620 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c170d9998d4adb83e4160604c26bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:22.177320 6196 tablet_service.cc:1467] Processing CreateTablet for tablet 29c170d9998d4adb83e4160604c26bf3 (DEFAULT_TABLE table=test-table [id=a72a2b08c6d54bdc88120a8c5a0a725b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:52:22.178858 6196 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 29c170d9998d4adb83e4160604c26bf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:22.190558 6746 tablet_bootstrap.cc:492] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Bootstrap starting.
I20260807 19:52:22.192909 6747 tablet_bootstrap.cc:492] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Bootstrap starting.
I20260807 19:52:22.195976 6746 tablet_bootstrap.cc:654] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:22.197104 6746 log.cc:824] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:22.197359 6747 tablet_bootstrap.cc:654] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:22.198794 6750 tablet_bootstrap.cc:492] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Bootstrap starting.
I20260807 19:52:22.198786 6747 log.cc:824] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:22.201941 6750 tablet_bootstrap.cc:654] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:22.202113 6747 tablet_bootstrap.cc:492] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: No bootstrap required, opened a new log
I20260807 19:52:22.202113 6746 tablet_bootstrap.cc:492] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: No bootstrap required, opened a new log
I20260807 19:52:22.202394 6746 ts_tablet_manager.cc:1397] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Time spent bootstrapping tablet: real 0.012s user 0.008s sys 0.000s
I20260807 19:52:22.202406 6747 ts_tablet_manager.cc:1397] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Time spent bootstrapping tablet: real 0.010s user 0.009s sys 0.000s
I20260807 19:52:22.203094 6750 log.cc:824] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:22.206460 6750 tablet_bootstrap.cc:492] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: No bootstrap required, opened a new log
I20260807 19:52:22.206753 6750 ts_tablet_manager.cc:1397] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Time spent bootstrapping tablet: real 0.008s user 0.004s sys 0.003s
I20260807 19:52:22.213420 6746 raft_consensus.cc:348] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.213425 6747 raft_consensus.cc:348] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.213915 6747 raft_consensus.cc:374] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:22.213915 6746 raft_consensus.cc:374] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:22.214025 6747 raft_consensus.cc:729] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b99618179f4586a49e1f32d21e7187, State: Initialized, Role: FOLLOWER
I20260807 19:52:22.214030 6746 raft_consensus.cc:729] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a07e94fa94e85bc8cc05429895f1d, State: Initialized, Role: FOLLOWER
I20260807 19:52:22.214349 6750 raft_consensus.cc:348] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.214809 6750 raft_consensus.cc:374] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:22.214699 6747 consensus_queue.cc:260] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.214699 6746 consensus_queue.cc:260] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.214941 6750 raft_consensus.cc:729] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bae997f34414435a0d90c5bcc16ba7d, State: Initialized, Role: FOLLOWER
I20260807 19:52:22.215727 6750 consensus_queue.cc:260] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.216809 6747 ts_tablet_manager.cc:1428] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260807 19:52:22.217875 6716 heartbeater.cc:503] Master 127.12.155.190:43061 was elected leader, sending a full tablet report...
I20260807 19:52:22.219018 6750 ts_tablet_manager.cc:1428] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Time spent starting tablet: real 0.012s user 0.006s sys 0.005s
I20260807 19:52:22.220327 6506 heartbeater.cc:503] Master 127.12.155.190:43061 was elected leader, sending a full tablet report...
I20260807 19:52:22.220918 6746 ts_tablet_manager.cc:1428] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Time spent starting tablet: real 0.018s user 0.014s sys 0.004s
W20260807 19:52:22.229324 6303 tablet.cc:2369] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:22.286509 6757 raft_consensus.cc:482] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:22.286881 6757 raft_consensus.cc:504] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.288866 6757 leader_election.cc:288] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131:35765), 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947)
W20260807 19:52:22.292711 6508 tablet.cc:2369] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:22.296537 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.289368 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:33517 (local address 127.12.155.131:35765)
0807 19:52:22.289706 (+ 338us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.289716 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.290212 (+ 496us) server_negotiation.cc:407] Connection header received
0807 19:52:22.290585 (+ 373us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.290591 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.290680 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.290757 (+ 77us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:22.291699 (+ 942us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.292625 (+ 926us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.294824 (+ 2199us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.295593 (+ 769us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.295788 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.295865 (+ 77us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.296143 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.296277 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":66}
I20260807 19:52:22.296695 6764 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.289273 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35765 (local address 127.12.155.130:33517)
0807 19:52:22.290030 (+ 757us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:22.290052 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:22.290375 (+ 323us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:22.291016 (+ 641us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:22.291023 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:22.291057 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:22.291531 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.291543 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.292797 (+ 1254us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.292807 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.294637 (+ 1830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.294651 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.295822 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.295828 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.295980 (+ 152us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.296005 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:52:22.296114 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 19:52:22.296240 (+ 126us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":599,"mutex_wait_us":97,"thread_start_us":382,"threads_started":1}
I20260807 19:52:22.297240 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.290437 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:60997 (local address 127.12.155.129:34947)
0807 19:52:22.290719 (+ 282us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.290726 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.291196 (+ 470us) server_negotiation.cc:407] Connection header received
0807 19:52:22.291431 (+ 235us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.291436 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.291492 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.291590 (+ 98us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:22.292114 (+ 524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.292889 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.295196 (+ 2307us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.296084 (+ 888us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.296282 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.296369 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.296783 (+ 414us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.296942 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 19:52:22.297837 6765 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.290137 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34947 (local address 127.12.155.130:60997)
0807 19:52:22.291075 (+ 938us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:22.291090 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:22.291273 (+ 183us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:22.291609 (+ 336us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:22.291613 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:22.291638 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:22.291961 (+ 323us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.291969 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.293054 (+ 1085us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.293060 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.295021 (+ 1961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:22.295036 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.296335 (+ 1299us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.296342 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:22.296534 (+ 192us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.296559 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:52:22.297392 (+ 833us) client_negotiation.cc:240] Negotiation successful
0807 19:52:22.297546 (+ 154us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":842,"mutex_wait_us":27,"thread_start_us":302,"threads_started":1}
I20260807 19:52:22.297835 6647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c170d9998d4adb83e4160604c26bf3" candidate_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bae997f34414435a0d90c5bcc16ba7d" is_pre_election: true
I20260807 19:52:22.298465 6647 raft_consensus.cc:2454] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a07e94fa94e85bc8cc05429895f1d in term 0.
I20260807 19:52:22.299021 6226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c170d9998d4adb83e4160604c26bf3" candidate_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b99618179f4586a49e1f32d21e7187" is_pre_election: true
I20260807 19:52:22.299271 6336 leader_election.cc:302] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a07e94fa94e85bc8cc05429895f1d, 8bae997f34414435a0d90c5bcc16ba7d; no voters:
I20260807 19:52:22.299532 6226 raft_consensus.cc:2454] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0e7a07e94fa94e85bc8cc05429895f1d in term 0.
I20260807 19:52:22.299841 6757 raft_consensus.cc:2781] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:52:22.300060 6757 raft_consensus.cc:482] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:52:22.300230 6757 raft_consensus.cc:3037] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:22.303093 6757 raft_consensus.cc:504] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.303745 6757 leader_election.cc:288] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [CANDIDATE]: Term 1 election: Requested vote from peers 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131:35765), 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947)
I20260807 19:52:22.304260 6647 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c170d9998d4adb83e4160604c26bf3" candidate_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8bae997f34414435a0d90c5bcc16ba7d"
I20260807 19:52:22.304337 6226 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "29c170d9998d4adb83e4160604c26bf3" candidate_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b99618179f4586a49e1f32d21e7187"
I20260807 19:52:22.304518 6647 raft_consensus.cc:3037] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:22.304540 6226 raft_consensus.cc:3037] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:22.307890 6647 raft_consensus.cc:2454] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a07e94fa94e85bc8cc05429895f1d in term 1.
I20260807 19:52:22.307891 6226 raft_consensus.cc:2454] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0e7a07e94fa94e85bc8cc05429895f1d in term 1.
I20260807 19:52:22.308308 6336 leader_election.cc:302] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a07e94fa94e85bc8cc05429895f1d, 8bae997f34414435a0d90c5bcc16ba7d; no voters:
I20260807 19:52:22.308707 6757 raft_consensus.cc:2781] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:52:22.309168 6757 raft_consensus.cc:686] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 LEADER]: Becoming Leader. State: Replica: 0e7a07e94fa94e85bc8cc05429895f1d, State: Running, Role: LEADER
I20260807 19:52:22.309757 6757 consensus_queue.cc:237] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } }
I20260807 19:52:22.314829 5985 catalog_manager.cc:5495] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d reported cstate change: term changed from 0 to 1, leader changed from <none> to 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130). New cstate: current_term: 1 leader_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } health_report { overall_health: UNKNOWN } } }
W20260807 19:52:22.338161 6719 tablet.cc:2369] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:22.361801 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.356252 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57190 (local address 127.12.155.130:44957)
0807 19:52:22.356489 (+ 237us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.356496 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.356515 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:52:22.356618 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.356623 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.356708 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.356873 (+ 165us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:52:22.357278 (+ 405us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.358011 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.359535 (+ 1524us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.359953 (+ 418us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.360100 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.360643 (+ 543us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:52:22.361153 (+ 510us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:52:22.361320 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.361421 (+ 101us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.361510 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:52:22.369938 6647 raft_consensus.cc:1261] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Refusing update from remote peer 0e7a07e94fa94e85bc8cc05429895f1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:52:22.369920 6226 raft_consensus.cc:1261] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Refusing update from remote peer 0e7a07e94fa94e85bc8cc05429895f1d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:52:22.371002 6767 consensus_queue.cc:1035] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:52:22.371429 6757 consensus_queue.cc:1035] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [LEADER]: Connected to new peer: Peer: permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:52:22.384716 6770 mvcc.cc:205] Tried to move back new op lower bound from 7315998074337452032 to 7315998074104713216. Current Snapshot: MvccSnapshot[applied={T|T < 7315998074337452032}]
I20260807 19:52:22.398033 5985 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:52:22.398381 5985 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:53422:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:52:22.402179 5985 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Sending DeleteTablet for 3 replicas of tablet 29c170d9998d4adb83e4160604c26bf3
I20260807 19:52:22.403653 6405 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c170d9998d4adb83e4160604c26bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:22 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:57180
I20260807 19:52:22.403698 6196 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c170d9998d4adb83e4160604c26bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:22 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:45056
I20260807 19:52:22.403810 6620 tablet_service.cc:1514] Processing DeleteTablet for tablet 29c170d9998d4adb83e4160604c26bf3 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:22 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:39330
I20260807 19:52:22.404762 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 6092
I20260807 19:52:22.414615 6789 tablet_replica.cc:330] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: stopping tablet replica
I20260807 19:52:22.415230 6789 raft_consensus.cc:2229] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:52:22.417202 6788 tablet_replica.cc:330] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: stopping tablet replica
I20260807 19:52:22.417809 6789 raft_consensus.cc:2258] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:22.417855 6788 raft_consensus.cc:2229] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:52:22.418830 6788 raft_consensus.cc:2258] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:22.420320 6789 ts_tablet_manager.cc:1905] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:22.421187 6788 ts_tablet_manager.cc:1905] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:22.421865 6787 tablet_replica.cc:330] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: stopping tablet replica
I20260807 19:52:22.423069 6787 raft_consensus.cc:2229] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:52:22.423669 6787 raft_consensus.cc:2258] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:22.427891 6789 ts_tablet_manager.cc:1918] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:22.428059 6789 log.cc:1196] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/29c170d9998d4adb83e4160604c26bf3
I20260807 19:52:22.428624 6789 ts_tablet_manager.cc:1939] T 29c170d9998d4adb83e4160604c26bf3 P 8bae997f34414435a0d90c5bcc16ba7d: Deleting consensus metadata
I20260807 19:52:22.428825 6787 ts_tablet_manager.cc:1905] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:22.430517 5966 catalog_manager.cc:4841] TS 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131:35765): tablet 29c170d9998d4adb83e4160604c26bf3 (table test-table [id=a72a2b08c6d54bdc88120a8c5a0a725b]) successfully deleted
I20260807 19:52:22.431442 6788 ts_tablet_manager.cc:1918] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:22.431629 6788 log.cc:1196] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/29c170d9998d4adb83e4160604c26bf3
I20260807 19:52:22.432216 6788 ts_tablet_manager.cc:1939] T 29c170d9998d4adb83e4160604c26bf3 P 0e7a07e94fa94e85bc8cc05429895f1d: Deleting consensus metadata
Aug 07 19:52:22 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:52:22.434234 5966 catalog_manager.cc:4841] TS 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130:44957): tablet 29c170d9998d4adb83e4160604c26bf3 (table test-table [id=a72a2b08c6d54bdc88120a8c5a0a725b]) successfully deleted
I20260807 19:52:22.436866 6787 ts_tablet_manager.cc:1918] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:22.437031 6787 log.cc:1196] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/29c170d9998d4adb83e4160604c26bf3
I20260807 19:52:22.437605 6787 ts_tablet_manager.cc:1939] T 29c170d9998d4adb83e4160604c26bf3 P 67b99618179f4586a49e1f32d21e7187: Deleting consensus metadata
I20260807 19:52:22.439546 5966 catalog_manager.cc:4841] TS 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947): tablet 29c170d9998d4adb83e4160604c26bf3 (table test-table [id=a72a2b08c6d54bdc88120a8c5a0a725b]) successfully deleted
I20260807 19:52:22.442513 6742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.405796 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45068 (local address 127.12.155.129:34947)
0807 19:52:22.406031 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.406040 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.417636 (+ 11596us) server_negotiation.cc:407] Connection header received
0807 19:52:22.418748 (+ 1112us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.418754 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.418854 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.418945 (+ 91us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:22.421711 (+ 2766us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.422908 (+ 1197us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.424992 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.425630 (+ 638us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.425732 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.435336 (+ 9604us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:22.435351 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:22.435368 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:22.435416 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:22.439546 (+ 4130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.440308 (+ 762us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.440318 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.440322 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.440463 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.440861 (+ 398us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.440866 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.440870 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.441249 (+ 379us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:22.441560 (+ 311us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.441892 (+ 332us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.442133 (+ 241us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:52:22.443251 6294 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:22.535056 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 6092
I20260807 19:52:22.572212 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 6308
Aug 07 19:52:22 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:52:22.589524 6739 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.573063 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57206 (local address 127.12.155.130:44957)
0807 19:52:22.573328 (+ 265us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.573339 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.573429 (+ 90us) server_negotiation.cc:407] Connection header received
0807 19:52:22.573633 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.573639 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.573719 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.573844 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:22.575325 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.576199 (+ 874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.577610 (+ 1411us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.578254 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.578395 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.583022 (+ 4627us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:22.583037 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:22.583054 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:22.583088 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:22.586444 (+ 3356us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.587212 (+ 768us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.587223 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.587226 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.587374 (+ 148us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.587809 (+ 435us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.587815 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.587818 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.588230 (+ 412us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:22.588588 (+ 358us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.588884 (+ 296us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.589109 (+ 225us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":124}
I20260807 19:52:22.590278 6500 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:22.705972 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 6308
I20260807 19:52:22.733318 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 6523
Aug 07 19:52:22 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132339, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:52:22.749846 6741 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:22.734170 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39340 (local address 127.12.155.131:35765)
0807 19:52:22.734383 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:22.734388 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:22.734406 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:52:22.734531 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:22.734535 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:22.734603 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:22.734699 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:22.736063 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.736778 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.738371 (+ 1593us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:22.738762 (+ 391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:22.738858 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:22.743534 (+ 4676us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:22.743553 (+ 19us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:22.743571 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:22.743618 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:22.746924 (+ 3306us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.747720 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.747728 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.747730 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.747886 (+ 156us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:22.748273 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:22.748277 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:22.748279 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:22.748666 (+ 387us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:22.748910 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:22.749269 (+ 359us) server_negotiation.cc:299] Negotiation successful
0807 19:52:22.749496 (+ 227us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":85}
I20260807 19:52:22.750696 6709 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:22.842751 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 6523
I20260807 19:52:22.867244 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 5935
I20260807 19:52:22.868553 6035 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:22.980269 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 5935
I20260807 19:52:43.006726 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43061
--webserver_interface=127.12.155.190
--webserver_port=42249
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--tsk_private_key_password_cmd=echo foo with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:52:43.360327 6796 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:43.360669 6796 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:43.360846 6796 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:43.368248 6796 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 19:52:43.368379 6796 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 19:52:43.368489 6796 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 19:52:43.368590 6796 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:52:43.368700 6796 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:43.368826 6796 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:43.368918 6796 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:52:43.369004 6796 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:52:43.378996 6796 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_private_key_password_cmd=echo foo
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=42249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:43.380324 6796 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:43.381721 6796 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:43.407814 6805 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:43.407840 6807 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:43.407883 6810 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:43.408293 6796 server_base.cc:1034] running on GCE node
I20260807 19:52:43.409456 6796 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:43.411233 6796 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:43.412515 6796 hybrid_clock.cc:648] HybridClock initialized: now 1786132363412435 us; error 36 us; skew 500 ppm
I20260807 19:52:43.412930 6796 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:43 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132363, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:43.423776 6796 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:52:43.425678 6796 webserver.cc:460] Webserver started at http://127.12.155.190:42249/ using document root <none> and password file <none>
I20260807 19:52:43.426599 6796 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:43.426769 6796 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:43.433065 6796 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.001s sys 0.004s
I20260807 19:52:43.436228 6819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:43.437664 6796 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:52:43.437871 6796 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "7b0110de43704a04b4001484da807d5c"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "f0d6300b4bce2f6d9d04bbd6a2e5cfa4"
server_key_iv: "3bcd366b33c3b8fa903a254466f47c45"
server_key_version: "encryptionkey@0"
I20260807 19:52:43.439041 6796 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:43.455130 6796 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:43.459781 6796 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:43.460155 6796 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:43.480721 6796 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43061
I20260807 19:52:43.480767 6905 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43061 every 8 connection(s)
I20260807 19:52:43.482470 6796 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:52:43.489270 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 6796
I20260807 19:52:43.490163 6906 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:52:43.490434 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:34947
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:43061
--webserver_port=46087
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:52:43.495741 6906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap starting.
I20260807 19:52:43.518775 6906 log.cc:824] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:43.531872 6906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=8 overwritten=0 applied=8 ignored=0} inserts{seen=5 ignored=0} mutations{seen=4 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:52:43.532456 6906 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap complete.
I20260807 19:52:43.542238 6906 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:43.543258 6906 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b0110de43704a04b4001484da807d5c, State: Initialized, Role: FOLLOWER
I20260807 19:52:43.543967 6906 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:43.544260 6906 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:52:43.544410 6906 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:52:43.544616 6906 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 1 FOLLOWER]: Advancing to term 2
I20260807 19:52:43.548883 6906 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:43.549446 6906 leader_election.cc:302] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b0110de43704a04b4001484da807d5c; no voters:
I20260807 19:52:43.550173 6906 leader_election.cc:288] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [CANDIDATE]: Term 2 election: Requested vote from peers
I20260807 19:52:43.550330 6910 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Leader election won for term 2
I20260807 19:52:43.551826 6910 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 LEADER]: Becoming Leader. State: Replica: 7b0110de43704a04b4001484da807d5c, State: Running, Role: LEADER
I20260807 19:52:43.552436 6910 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 8, Committed index: 8, Last appended: 1.8, Last appended by leader: 8, Current term: 2, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:52:43.552858 6906 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:52:43.555464 6911 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 2 leader_uuid: "7b0110de43704a04b4001484da807d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } } }
I20260807 19:52:43.555536 6912 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0110de43704a04b4001484da807d5c. Latest consensus state: current_term: 2 leader_uuid: "7b0110de43704a04b4001484da807d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } } }
I20260807 19:52:43.555896 6911 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: This master's current role is: LEADER
I20260807 19:52:43.555989 6912 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: This master's current role is: LEADER
I20260807 19:52:43.557083 6916 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:52:43.568193 6916 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:52:43.570102 6916 catalog_manager.cc:1259] Loaded cluster ID: 4db9700a9ec04ebd981575be2303facb
I20260807 19:52:43.570230 6916 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:52:43.575369 6916 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:52:43.577493 6916 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Loaded TSK: 0
I20260807 19:52:43.624104 6916 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Generated new TSK 1
I20260807 19:52:43.624579 6916 catalog_manager.cc:1514] Initializing in-progress tserver states...
W20260807 19:52:43.884737 6908 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:43.885015 6908 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:43.885177 6908 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:43.892699 6908 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:43.892804 6908 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:43.892971 6908 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:52:43.903195 6908 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:34947
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=46087
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:43.904580 6908 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:43.905931 6908 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:43.920851 6949 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:43.920921 6948 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:43.921509 6951 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:43.922827 6908 server_base.cc:1034] running on GCE node
I20260807 19:52:43.923533 6908 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:43.924798 6908 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:43.926072 6908 hybrid_clock.cc:648] HybridClock initialized: now 1786132363925989 us; error 57 us; skew 500 ppm
I20260807 19:52:43.926450 6908 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:43 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132363, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:43.930620 6908 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:52:43.932533 6908 webserver.cc:460] Webserver started at http://127.12.155.129:46087/ using document root <none> and password file <none>
I20260807 19:52:43.933408 6908 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:43.933579 6908 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:43.941018 6908 fs_manager.cc:709] Time spent opening directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:52:43.944777 6967 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:43.946547 6908 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:52:43.946790 6908 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "67b99618179f4586a49e1f32d21e7187"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "cf0b8c0880fe76934827a455b7ad70d1"
server_key_iv: "63ec50e90ab9589ea468bfcfcf56b1a3"
server_key_version: "encryptionkey@0"
I20260807 19:52:43.948105 6908 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:43.970809 6908 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:43.976074 6908 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:43.976382 6908 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:43.977577 6908 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:43.979152 6908 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:43.979264 6908 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:43.979336 6908 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:43.979394 6908 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.015961 6908 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34947
I20260807 19:52:44.016042 7138 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34947 every 8 connection(s)
I20260807 19:52:44.017527 6908 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:52:44.024132 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 6908
I20260807 19:52:44.024806 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:44957
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:43061
--webserver_port=44225
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:52:44 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132363, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:44.041843 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.020507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:53311 (local address 127.12.155.190:43061)
0807 19:52:44.021294 (+ 787us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:44.021319 (+ 25us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:44.021887 (+ 568us) server_negotiation.cc:407] Connection header received
0807 19:52:44.024046 (+ 2159us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:44.024057 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:44.024426 (+ 369us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:44.024792 (+ 366us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:44.026378 (+ 1586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.027624 (+ 1246us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.029150 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.029772 (+ 622us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.029978 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:44.033547 (+ 3569us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:44.033555 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:44.033568 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:44.033603 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:44.037300 (+ 3697us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:44.038050 (+ 750us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:44.038102 (+ 52us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:44.038110 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:44.038319 (+ 209us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:44.038771 (+ 452us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:44.038776 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:44.038779 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:44.039243 (+ 464us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:44.039451 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:44.040213 (+ 762us) server_negotiation.cc:299] Negotiation successful
0807 19:52:44.040586 (+ 373us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":522,"thread_start_us":460,"threads_started":1}
I20260807 19:52:44.041842 7143 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.020741 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:53311)
0807 19:52:44.021701 (+ 960us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:44.021745 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:44.023519 (+ 1774us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:44.024942 (+ 1423us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:44.024954 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:44.025549 (+ 595us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:44.026138 (+ 589us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:44.026158 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.027798 (+ 1640us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.027803 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:44.029001 (+ 1198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:44.029014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.030014 (+ 1000us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.030022 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:44.030343 (+ 321us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:44.031093 (+ 750us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:44.031115 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:44.033266 (+ 2151us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:44.037455 (+ 4189us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:44.037463 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:44.037477 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:44.037894 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:44.038442 (+ 548us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:44.038447 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:44.038451 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:44.038641 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:44.039389 (+ 748us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:44.039397 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:44.039725 (+ 328us) client_negotiation.cc:769] Sending connection context
0807 19:52:44.039979 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 19:52:44.040527 (+ 548us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":683,"thread_start_us":440,"threads_started":1}
I20260807 19:52:44.045122 7139 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43061
I20260807 19:52:44.045465 7139 heartbeater.cc:464] Registering TS with master...
I20260807 19:52:44.046377 7139 heartbeater.cc:511] Master 127.12.155.190:43061 requested a full tablet report, sending...
I20260807 19:52:44.049070 6844 ts_manager.cc:194] Registered new tserver with Master: 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947)
I20260807 19:52:44.051556 6844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:53311
W20260807 19:52:44.372308 7144 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:44.372665 7144 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:44.372771 7144 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:44.380610 7144 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:44.380718 7144 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:44.380831 7144 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:52:44.390316 7144 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:44957
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=44225
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:44.391498 7144 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:44.392784 7144 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:44.405804 7157 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:44.405746 7158 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:44.405742 7161 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:44.406944 7144 server_base.cc:1034] running on GCE node
I20260807 19:52:44.407598 7144 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:44.408476 7144 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:44.409722 7144 hybrid_clock.cc:648] HybridClock initialized: now 1786132364409664 us; error 52 us; skew 500 ppm
I20260807 19:52:44.410007 7144 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:44 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132364, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:44.413285 7144 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:52:44.414774 7144 webserver.cc:460] Webserver started at http://127.12.155.130:44225/ using document root <none> and password file <none>
I20260807 19:52:44.415490 7144 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:44.415617 7144 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:44.420956 7144 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.005s sys 0.000s
I20260807 19:52:44.423767 7172 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.425073 7144 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:52:44.425251 7144 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "0e7a07e94fa94e85bc8cc05429895f1d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "696aa4c7b175eb79a36603f44a9b3de4"
server_key_iv: "44fe4dbd73929807d715bffd682bf287"
server_key_version: "encryptionkey@0"
I20260807 19:52:44.426273 7144 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:44.466322 7144 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:44.470707 7144 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:44.471006 7144 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:44.472066 7144 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:44.473584 7144 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:44.473680 7144 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.473850 7144 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:44.473966 7144 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.510437 7144 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:44957
I20260807 19:52:44.510535 7353 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:44957 every 8 connection(s)
I20260807 19:52:44.511981 7144 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:52:44.517055 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 7144
I20260807 19:52:44.517688 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:35765
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:43061
--webserver_port=36949
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
Aug 07 19:52:44 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132364, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:44.535051 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.514822 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:36457 (local address 127.12.155.190:43061)
0807 19:52:44.515033 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:44.515038 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:44.516349 (+ 1311us) server_negotiation.cc:407] Connection header received
0807 19:52:44.518412 (+ 2063us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:44.518421 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:44.518533 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:44.518658 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:44.520109 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.521261 (+ 1152us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.523064 (+ 1803us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.523828 (+ 764us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.523981 (+ 153us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:44.527745 (+ 3764us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:44.527754 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:44.527762 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:44.527809 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:44.531608 (+ 3799us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:44.532339 (+ 731us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:44.532348 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:44.532355 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:44.532513 (+ 158us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:44.532952 (+ 439us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:44.532960 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:44.532966 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:44.533388 (+ 422us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:44.533569 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:44.534291 (+ 722us) server_negotiation.cc:299] Negotiation successful
0807 19:52:44.534573 (+ 282us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:52:44.535772 7359 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.515311 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:36457)
0807 19:52:44.516176 (+ 865us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:44.516221 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:44.518137 (+ 1916us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:44.518851 (+ 714us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:44.518858 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:44.519367 (+ 509us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:44.519923 (+ 556us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:44.519942 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.521448 (+ 1506us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.521453 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:44.522886 (+ 1433us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:44.522899 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.524063 (+ 1164us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.524069 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:44.524280 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:44.525038 (+ 758us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:44.525060 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:44.527495 (+ 2435us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:44.531753 (+ 4258us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:44.531759 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:44.531772 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:44.532194 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:44.532623 (+ 429us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:44.532626 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:44.532628 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:44.532830 (+ 202us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:44.533520 (+ 690us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:44.533526 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:44.533848 (+ 322us) client_negotiation.cc:769] Sending connection context
0807 19:52:44.534159 (+ 311us) client_negotiation.cc:240] Negotiation successful
0807 19:52:44.534555 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":620,"thread_start_us":421,"threads_started":1}
I20260807 19:52:44.537389 7355 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43061
I20260807 19:52:44.537742 7355 heartbeater.cc:464] Registering TS with master...
I20260807 19:52:44.538739 7355 heartbeater.cc:511] Master 127.12.155.190:43061 requested a full tablet report, sending...
I20260807 19:52:44.540421 6844 ts_manager.cc:194] Registered new tserver with Master: 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130:44957)
I20260807 19:52:44.541242 6844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:36457
W20260807 19:52:44.866101 7360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:52:44.866375 7360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:52:44.866554 7360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:52:44.874262 7360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:52:44.874392 7360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:52:44.874583 7360 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:52:44.885543 7360 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:35765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=36949
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:52:44.886955 7360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:52:44.888315 7360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:52:44.900796 7368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:44.901400 7369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:52:44.902657 7373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:52:44.903360 7360 server_base.cc:1034] running on GCE node
I20260807 19:52:44.904008 7360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:52:44.905076 7360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:52:44.906323 7360 hybrid_clock.cc:648] HybridClock initialized: now 1786132364906273 us; error 30 us; skew 500 ppm
I20260807 19:52:44.906682 7360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:52:44 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132364, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:52:44.909991 7360 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:52:44.911619 7360 webserver.cc:460] Webserver started at http://127.12.155.131:36949/ using document root <none> and password file <none>
I20260807 19:52:44.912391 7360 fs_manager.cc:359] Metadata directory not provided
I20260807 19:52:44.912580 7360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:52:44.918357 7360 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:52:44.921218 7389 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.922899 7360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:52:44.923153 7360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "8bae997f34414435a0d90c5bcc16ba7d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "0e0ccbec5ab2f7fa5c6dcdc094094226"
server_key_iv: "06d2eded752c1330080434a1c188c701"
server_key_version: "encryptionkey@0"
I20260807 19:52:44.924254 7360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:52:44.941975 7360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:52:44.946367 7360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:52:44.946678 7360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:52:44.947751 7360 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:52:44.949144 7360 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:52:44.949272 7360 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.949414 7360 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:52:44.949512 7360 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:52:44.984380 7360 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:35765
I20260807 19:52:44.984496 7571 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:35765 every 8 connection(s)
I20260807 19:52:44.985906 7360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:52:44.991745 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 7360
Aug 07 19:52:44 dist-test-slave-2p8l krb5kdc[5913](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132364, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:52:45.008247 7142 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.988605 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:48635 (local address 127.12.155.190:43061)
0807 19:52:44.988811 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:44.988816 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:44.989961 (+ 1145us) server_negotiation.cc:407] Connection header received
0807 19:52:44.991843 (+ 1882us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:44.991848 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:44.991950 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:44.992064 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:44.993952 (+ 1888us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.994760 (+ 808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.996760 (+ 2000us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.997176 (+ 416us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.997282 (+ 106us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.001510 (+ 4228us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:45.001515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:45.001518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:45.001549 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:45.004848 (+ 3299us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.005549 (+ 701us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.005553 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.005555 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.005668 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.006218 (+ 550us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.006246 (+ 28us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.006251 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.006623 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:45.006734 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.007577 (+ 843us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.007824 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78,"spinlock_wait_cycles":1408}
I20260807 19:52:45.008626 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.992762 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54634 (local address 127.12.155.190:43061)
0807 19:52:44.993642 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:44.993646 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:44.993661 (+ 15us) server_negotiation.cc:407] Connection header received
0807 19:52:44.993710 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:44.993713 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:44.993762 (+ 49us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:44.993849 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:44.995895 (+ 2046us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.996584 (+ 689us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.998416 (+ 1832us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.998826 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.998919 (+ 93us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.002315 (+ 3396us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:45.002324 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:45.002329 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:45.002394 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:45.005376 (+ 2982us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.006302 (+ 926us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.006308 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.006312 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.006423 (+ 111us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.006935 (+ 512us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.006938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.006940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.007174 (+ 234us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:45.007360 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.007824 (+ 464us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.008018 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":795,"thread_start_us":685,"threads_started":1}
I20260807 19:52:45.009255 7578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:44.989046 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:48635)
0807 19:52:44.989781 (+ 735us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:44.989822 (+ 41us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:44.991574 (+ 1752us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:44.992299 (+ 725us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:44.992307 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:44.992869 (+ 562us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:52:44.993756 (+ 887us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:44.993777 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.994931 (+ 1154us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.994939 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:44.996583 (+ 1644us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:44.996596 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:44.997405 (+ 809us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:44.997414 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:44.997703 (+ 289us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:44.998483 (+ 780us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:52:44.998506 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:52:45.001291 (+ 2785us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:52:45.005000 (+ 3709us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:45.005012 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:45.005025 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:45.005421 (+ 396us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:45.005779 (+ 358us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:52:45.005784 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:52:45.005787 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:52:45.006100 (+ 313us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:52:45.006754 (+ 654us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:52:45.006762 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:52:45.007173 (+ 411us) client_negotiation.cc:769] Sending connection context
0807 19:52:45.007491 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 19:52:45.008048 (+ 557us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":498,"thread_start_us":293,"threads_started":1}
I20260807 19:52:45.010707 7573 heartbeater.cc:347] Connected to a master server at 127.12.155.190:43061
I20260807 19:52:45.011039 7573 heartbeater.cc:464] Registering TS with master...
I20260807 19:52:45.011883 7573 heartbeater.cc:511] Master 127.12.155.190:43061 requested a full tablet report, sending...
I20260807 19:52:45.013229 6844 ts_manager.cc:194] Registered new tserver with Master: 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131:35765)
I20260807 19:52:45.014130 6844 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:48635
I20260807 19:52:45.023854 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:52:45.031255 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.024889 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54636 (local address 127.12.155.190:43061)
0807 19:52:45.025142 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.025150 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.025515 (+ 365us) server_negotiation.cc:407] Connection header received
0807 19:52:45.025786 (+ 271us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.025790 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.025923 (+ 133us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.026096 (+ 173us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:52:45.026625 (+ 529us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.027347 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.029059 (+ 1712us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.029534 (+ 475us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.029716 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.030252 (+ 536us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:52:45.030578 (+ 326us) server_negotiation.cc:394] Sending RPC error: FATAL_INVALID_AUTHENTICATION_TOKEN: Not authorized: token expired
0807 19:52:45.030975 (+ 397us) negotiation.cc:327] Negotiation complete: Not authorized: Server connection negotiation failed: server connection from 127.0.0.1:54636: token expired
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 19:52:45.031400 7583 negotiation.cc:344] Unauthorized connection attempt: Server connection negotiation failed: server connection from 127.0.0.1:54636: token expired
W20260807 19:52:45.032063 6726 master_proxy_rpc.cc:203] Re-attempting CreateTable request to leader Master (127.12.155.190:43061)
I20260807 19:52:45.045560 7583 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.032747 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54646 (local address 127.12.155.190:43061)
0807 19:52:45.032902 (+ 155us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.032906 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.032924 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:52:45.032968 (+ 44us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.032972 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.033030 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.033148 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:45.034653 (+ 1505us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.035393 (+ 740us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.036803 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.037229 (+ 426us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.037338 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.039912 (+ 2574us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:45.039917 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:45.039921 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:45.039954 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:45.042904 (+ 2950us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.043482 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.043486 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.043489 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.043657 (+ 168us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.044171 (+ 514us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.044174 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.044176 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.044518 (+ 342us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:45.044757 (+ 239us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.045010 (+ 253us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.045175 (+ 165us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":51}
I20260807 19:52:45.056103 7139 heartbeater.cc:503] Master 127.12.155.190:43061 was elected leader, sending a full tablet report...
I20260807 19:52:45.050709 6844 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54646:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:52:45.063640 6844 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:52:45.105882 7595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.080661 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56984 (local address 127.12.155.130:44957)
0807 19:52:45.096995 (+ 16334us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.097008 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.097051 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:52:45.097186 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.097208 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.097548 (+ 340us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.098618 (+ 1070us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:45.098858 (+ 240us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.100424 (+ 1566us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.103386 (+ 2962us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.104588 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.104791 (+ 203us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.104983 (+ 192us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.105349 (+ 366us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.105545 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":16103,"thread_start_us":15737,"threads_started":1}
I20260807 19:52:45.106138 7594 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.080430 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:44957 (local address 127.0.0.1:56984)
0807 19:52:45.081558 (+ 1128us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:45.081618 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:45.081965 (+ 347us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:45.097879 (+ 15914us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:45.097890 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:45.097936 (+ 46us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:45.098401 (+ 465us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.098414 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.100598 (+ 2184us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.100603 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.103151 (+ 2548us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.103175 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.104842 (+ 1667us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.104849 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.105094 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.105133 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:52:45.105278 (+ 145us) client_negotiation.cc:240] Negotiation successful
0807 19:52:45.105479 (+ 201us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":810,"mutex_wait_us":1,"thread_start_us":1283,"threads_started":1}
I20260807 19:52:45.109521 7605 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.083412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:35765 (local address 127.0.0.1:38236)
0807 19:52:45.099197 (+ 15785us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:45.099223 (+ 26us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:45.099352 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:45.101979 (+ 2627us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:45.101984 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:45.102014 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:45.102592 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.102611 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.104236 (+ 1625us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.104243 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.107028 (+ 2785us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.107041 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.108580 (+ 1539us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.108586 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.108812 (+ 226us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.108846 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:52:45.108941 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 19:52:45.109069 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":15604,"mutex_wait_us":55,"thread_start_us":16055,"threads_started":1}
I20260807 19:52:45.109618 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.084058 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38236 (local address 127.12.155.131:35765)
0807 19:52:45.098460 (+ 14402us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.098472 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.099681 (+ 1209us) server_negotiation.cc:407] Connection header received
0807 19:52:45.099795 (+ 114us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.099806 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.100065 (+ 259us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.101631 (+ 1566us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:45.102851 (+ 1220us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.104026 (+ 1175us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.107263 (+ 3237us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.108347 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.108514 (+ 167us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.108666 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.109051 (+ 385us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.109225 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14204,"thread_start_us":14034,"threads_started":1}
I20260807 19:52:45.109694 7601 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.082693 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34947 (local address 127.0.0.1:56466)
0807 19:52:45.083342 (+ 649us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:45.083360 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:45.083478 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:45.099224 (+ 15746us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:45.099230 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:45.099266 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:45.099700 (+ 434us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.099715 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.101625 (+ 1910us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.101630 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.103842 (+ 2212us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.103857 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.106350 (+ 2493us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.106358 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.108868 (+ 2510us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.108896 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 19:52:45.109024 (+ 128us) client_negotiation.cc:240] Negotiation successful
0807 19:52:45.109196 (+ 172us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":499,"mutex_wait_us":2296,"thread_start_us":346,"threads_started":1}
I20260807 19:52:45.110478 7602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.083130 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56466 (local address 127.12.155.129:34947)
0807 19:52:45.098615 (+ 15485us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.098623 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.098649 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:52:45.098773 (+ 124us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.098780 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.098997 (+ 217us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.099214 (+ 217us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:45.099907 (+ 693us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.101448 (+ 1541us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.104039 (+ 2591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.105732 (+ 1693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.105964 (+ 232us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.106167 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.109914 (+ 3747us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.110110 (+ 196us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":15292,"thread_start_us":16257,"threads_started":1}
I20260807 19:52:45.110379 7243 tablet_service.cc:1467] Processing CreateTablet for tablet e27ae98950dc4e75921cc4733c3c3a08 (DEFAULT_TABLE table=test-table [id=b442274c157b4ca5beaef919d22945f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:52:45.111974 7243 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e27ae98950dc4e75921cc4733c3c3a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:45.113883 7463 tablet_service.cc:1467] Processing CreateTablet for tablet e27ae98950dc4e75921cc4733c3c3a08 (DEFAULT_TABLE table=test-table [id=b442274c157b4ca5beaef919d22945f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:52:45.114169 7041 tablet_service.cc:1467] Processing CreateTablet for tablet e27ae98950dc4e75921cc4733c3c3a08 (DEFAULT_TABLE table=test-table [id=b442274c157b4ca5beaef919d22945f6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:52:45.115204 7463 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e27ae98950dc4e75921cc4733c3c3a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:45.115765 7041 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet e27ae98950dc4e75921cc4733c3c3a08. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:52:45.130234 7610 tablet_bootstrap.cc:492] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Bootstrap starting.
I20260807 19:52:45.131965 7613 tablet_bootstrap.cc:492] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Bootstrap starting.
I20260807 19:52:45.133653 7610 tablet_bootstrap.cc:654] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:45.133894 7608 tablet_bootstrap.cc:492] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Bootstrap starting.
I20260807 19:52:45.134881 7613 tablet_bootstrap.cc:654] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:45.135121 7610 log.cc:824] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:45.136049 7613 log.cc:824] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:45.137697 7608 tablet_bootstrap.cc:654] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Neither blocks nor log segments found. Creating new log.
I20260807 19:52:45.138942 7610 tablet_bootstrap.cc:492] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: No bootstrap required, opened a new log
I20260807 19:52:45.139120 7608 log.cc:824] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Log is configured to *not* fsync() on all Append() calls
I20260807 19:52:45.139272 7610 ts_tablet_manager.cc:1397] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.003s
I20260807 19:52:45.142637 7608 tablet_bootstrap.cc:492] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: No bootstrap required, opened a new log
I20260807 19:52:45.142939 7608 ts_tablet_manager.cc:1397] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.000s
I20260807 19:52:45.143101 7613 tablet_bootstrap.cc:492] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: No bootstrap required, opened a new log
I20260807 19:52:45.143394 7613 ts_tablet_manager.cc:1397] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20260807 19:52:45.148452 7610 raft_consensus.cc:348] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.148855 7610 raft_consensus.cc:374] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:45.148999 7610 raft_consensus.cc:729] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8bae997f34414435a0d90c5bcc16ba7d, State: Initialized, Role: FOLLOWER
I20260807 19:52:45.149689 7610 consensus_queue.cc:260] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.150949 7573 heartbeater.cc:503] Master 127.12.155.190:43061 was elected leader, sending a full tablet report...
I20260807 19:52:45.151717 7610 ts_tablet_manager.cc:1428] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Time spent starting tablet: real 0.012s user 0.008s sys 0.003s
I20260807 19:52:45.154095 7608 raft_consensus.cc:348] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.154660 7608 raft_consensus.cc:374] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:45.154780 7608 raft_consensus.cc:729] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0e7a07e94fa94e85bc8cc05429895f1d, State: Initialized, Role: FOLLOWER
I20260807 19:52:45.154847 7613 raft_consensus.cc:348] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.155324 7613 raft_consensus.cc:374] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:52:45.155431 7613 raft_consensus.cc:729] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67b99618179f4586a49e1f32d21e7187, State: Initialized, Role: FOLLOWER
I20260807 19:52:45.155431 7608 consensus_queue.cc:260] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.156136 7613 consensus_queue.cc:260] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.156941 7355 heartbeater.cc:503] Master 127.12.155.190:43061 was elected leader, sending a full tablet report...
I20260807 19:52:45.157328 7608 ts_tablet_manager.cc:1428] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Time spent starting tablet: real 0.014s user 0.010s sys 0.004s
I20260807 19:52:45.157869 7613 ts_tablet_manager.cc:1428] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 19:52:45.204998 7620 raft_consensus.cc:482] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:52:45.205291 7620 raft_consensus.cc:504] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.207042 7620 leader_election.cc:288] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130:44957), 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947)
I20260807 19:52:45.213984 7595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.207480 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:59879 (local address 127.12.155.130:44957)
0807 19:52:45.207724 (+ 244us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.207732 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.207823 (+ 91us) server_negotiation.cc:407] Connection header received
0807 19:52:45.208082 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.208088 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.208178 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.208311 (+ 133us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:45.208865 (+ 554us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.209852 (+ 987us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.212100 (+ 2248us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.213086 (+ 986us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.213244 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.213323 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.213610 (+ 287us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.213737 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:52:45.213984 7578 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.207478 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:44957 (local address 127.12.155.131:59879)
0807 19:52:45.207714 (+ 236us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:45.207735 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:45.207890 (+ 155us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:45.208408 (+ 518us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:45.208420 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:45.208454 (+ 34us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:45.208675 (+ 221us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.208688 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.209984 (+ 1296us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.209988 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.211945 (+ 1957us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.211960 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.213243 (+ 1283us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.213249 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.213434 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.213460 (+ 26us) client_negotiation.cc:769] Sending connection context
0807 19:52:45.213571 (+ 111us) client_negotiation.cc:240] Negotiation successful
0807 19:52:45.213705 (+ 134us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":69}
I20260807 19:52:45.215044 7602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.208089 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:60391 (local address 127.12.155.129:34947)
0807 19:52:45.208300 (+ 211us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.208308 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.208846 (+ 538us) server_negotiation.cc:407] Connection header received
0807 19:52:45.209003 (+ 157us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.209009 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.209083 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.209183 (+ 100us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:52:45.209647 (+ 464us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.210517 (+ 870us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.212629 (+ 2112us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.213843 (+ 1214us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.213998 (+ 155us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.214092 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.214666 (+ 574us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.214796 (+ 130us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:52:45.215160 7623 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.207942 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:34947 (local address 127.12.155.131:60391)
0807 19:52:45.208728 (+ 786us) negotiation.cc:107] Waiting for socket to connect
0807 19:52:45.208751 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:52:45.208873 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:52:45.209202 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:52:45.209205 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:52:45.209224 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:52:45.209495 (+ 271us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.209501 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.210678 (+ 1177us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.210683 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.212471 (+ 1788us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:52:45.212481 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.214248 (+ 1767us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.214255 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:52:45.214430 (+ 175us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.214474 (+ 44us) client_negotiation.cc:769] Sending connection context
0807 19:52:45.214637 (+ 163us) client_negotiation.cc:240] Negotiation successful
0807 19:52:45.214778 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":643,"mutex_wait_us":4,"thread_start_us":384,"threads_started":1}
I20260807 19:52:45.214980 7274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27ae98950dc4e75921cc4733c3c3a08" candidate_uuid: "8bae997f34414435a0d90c5bcc16ba7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" is_pre_election: true
I20260807 19:52:45.215576 7274 raft_consensus.cc:2454] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bae997f34414435a0d90c5bcc16ba7d in term 0.
I20260807 19:52:45.216172 7068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27ae98950dc4e75921cc4733c3c3a08" candidate_uuid: "8bae997f34414435a0d90c5bcc16ba7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b99618179f4586a49e1f32d21e7187" is_pre_election: true
I20260807 19:52:45.216303 7393 leader_election.cc:302] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a07e94fa94e85bc8cc05429895f1d, 8bae997f34414435a0d90c5bcc16ba7d; no voters:
I20260807 19:52:45.216723 7620 raft_consensus.cc:2781] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:52:45.216714 7068 raft_consensus.cc:2454] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 8bae997f34414435a0d90c5bcc16ba7d in term 0.
I20260807 19:52:45.216848 7620 raft_consensus.cc:482] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:52:45.216974 7620 raft_consensus.cc:3037] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:45.219422 7620 raft_consensus.cc:504] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.220081 7620 leader_election.cc:288] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [CANDIDATE]: Term 1 election: Requested vote from peers 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130:44957), 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947)
I20260807 19:52:45.220530 7274 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27ae98950dc4e75921cc4733c3c3a08" candidate_uuid: "8bae997f34414435a0d90c5bcc16ba7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0e7a07e94fa94e85bc8cc05429895f1d"
I20260807 19:52:45.220625 7068 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27ae98950dc4e75921cc4733c3c3a08" candidate_uuid: "8bae997f34414435a0d90c5bcc16ba7d" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "67b99618179f4586a49e1f32d21e7187"
I20260807 19:52:45.220728 7274 raft_consensus.cc:3037] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:45.220878 7068 raft_consensus.cc:3037] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:52:45.223093 7274 raft_consensus.cc:2454] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bae997f34414435a0d90c5bcc16ba7d in term 1.
I20260807 19:52:45.223397 7068 raft_consensus.cc:2454] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 8bae997f34414435a0d90c5bcc16ba7d in term 1.
I20260807 19:52:45.223673 7393 leader_election.cc:302] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0e7a07e94fa94e85bc8cc05429895f1d, 8bae997f34414435a0d90c5bcc16ba7d; no voters:
I20260807 19:52:45.223958 7620 raft_consensus.cc:2781] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:52:45.224416 7620 raft_consensus.cc:686] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 LEADER]: Becoming Leader. State: Replica: 8bae997f34414435a0d90c5bcc16ba7d, State: Running, Role: LEADER
I20260807 19:52:45.224892 7620 consensus_queue.cc:237] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } }
I20260807 19:52:45.229561 6844 catalog_manager.cc:5495] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d reported cstate change: term changed from 0 to 1, leader changed from <none> to 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131). New cstate: current_term: 1 leader_uuid: "8bae997f34414435a0d90c5bcc16ba7d" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8bae997f34414435a0d90c5bcc16ba7d" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 35765 } health_report { overall_health: HEALTHY } } }
W20260807 19:52:45.237540 7576 tablet.cc:2369] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:45.255892 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.250459 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38240 (local address 127.12.155.131:35765)
0807 19:52:45.250668 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.250672 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.250690 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:52:45.250878 (+ 188us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.250882 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.250960 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.251116 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:52:45.251445 (+ 329us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.252192 (+ 747us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.253671 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.254190 (+ 519us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.254288 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.254794 (+ 506us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:52:45.255301 (+ 507us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:52:45.255426 (+ 125us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.255502 (+ 76us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.255567 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 19:52:45.263864 7274 raft_consensus.cc:1261] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Refusing update from remote peer 8bae997f34414435a0d90c5bcc16ba7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:52:45.263991 7068 raft_consensus.cc:1261] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Refusing update from remote peer 8bae997f34414435a0d90c5bcc16ba7d: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20260807 19:52:45.264086 7358 tablet.cc:2369] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:45.264957 7624 consensus_queue.cc:1035] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "0e7a07e94fa94e85bc8cc05429895f1d" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44957 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:52:45.265342 7620 consensus_queue.cc:1035] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [LEADER]: Connected to new peer: Peer: permanent_uuid: "67b99618179f4586a49e1f32d21e7187" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 34947 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:52:45.270032 7141 tablet.cc:2369] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:52:45.292879 6843 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:52:45.293175 6843 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54646:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:52:45.297062 6843 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Sending DeleteTablet for 3 replicas of tablet e27ae98950dc4e75921cc4733c3c3a08
I20260807 19:52:45.298188 7243 tablet_service.cc:1514] Processing DeleteTablet for tablet e27ae98950dc4e75921cc4733c3c3a08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:45 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:56984
I20260807 19:52:45.298370 7463 tablet_service.cc:1514] Processing DeleteTablet for tablet e27ae98950dc4e75921cc4733c3c3a08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:45 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:38236
I20260807 19:52:45.298424 7041 tablet_service.cc:1514] Processing DeleteTablet for tablet e27ae98950dc4e75921cc4733c3c3a08 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:52:45 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:56466
I20260807 19:52:45.299475 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 6908
I20260807 19:52:45.310950 7646 tablet_replica.cc:330] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: stopping tablet replica
I20260807 19:52:45.311165 7648 tablet_replica.cc:330] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: stopping tablet replica
I20260807 19:52:45.311543 7646 raft_consensus.cc:2229] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:52:45.311772 7648 raft_consensus.cc:2229] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:52:45.312300 7646 raft_consensus.cc:2258] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:45.312320 7648 raft_consensus.cc:2258] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:45.313239 7647 tablet_replica.cc:330] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: stopping tablet replica
I20260807 19:52:45.313683 7647 raft_consensus.cc:2229] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:52:45.314498 7647 raft_consensus.cc:2258] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:52:45.315027 7646 ts_tablet_manager.cc:1905] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:45.315814 7648 ts_tablet_manager.cc:1905] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:45.316777 7647 ts_tablet_manager.cc:1905] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:52:45.322651 7646 ts_tablet_manager.cc:1918] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:45.322651 7648 ts_tablet_manager.cc:1918] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:45.322820 7646 log.cc:1196] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/e27ae98950dc4e75921cc4733c3c3a08
I20260807 19:52:45.322820 7648 log.cc:1196] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/e27ae98950dc4e75921cc4733c3c3a08
I20260807 19:52:45.323388 7648 ts_tablet_manager.cc:1939] T e27ae98950dc4e75921cc4733c3c3a08 P 67b99618179f4586a49e1f32d21e7187: Deleting consensus metadata
I20260807 19:52:45.323388 7646 ts_tablet_manager.cc:1939] T e27ae98950dc4e75921cc4733c3c3a08 P 0e7a07e94fa94e85bc8cc05429895f1d: Deleting consensus metadata
I20260807 19:52:45.324468 7647 ts_tablet_manager.cc:1918] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:52:45.324741 7647 log.cc:1196] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/e27ae98950dc4e75921cc4733c3c3a08
I20260807 19:52:45.325373 7647 ts_tablet_manager.cc:1939] T e27ae98950dc4e75921cc4733c3c3a08 P 8bae997f34414435a0d90c5bcc16ba7d: Deleting consensus metadata
I20260807 19:52:45.325525 6823 catalog_manager.cc:4841] TS 0e7a07e94fa94e85bc8cc05429895f1d (127.12.155.130:44957): tablet e27ae98950dc4e75921cc4733c3c3a08 (table test-table [id=b442274c157b4ca5beaef919d22945f6]) successfully deleted
I20260807 19:52:45.327231 6823 catalog_manager.cc:4841] TS 8bae997f34414435a0d90c5bcc16ba7d (127.12.155.131:35765): tablet e27ae98950dc4e75921cc4733c3c3a08 (table test-table [id=b442274c157b4ca5beaef919d22945f6]) successfully deleted
I20260807 19:52:45.327840 6823 catalog_manager.cc:4841] TS 67b99618179f4586a49e1f32d21e7187 (127.12.155.129:34947): tablet e27ae98950dc4e75921cc4733c3c3a08 (table test-table [id=b442274c157b4ca5beaef919d22945f6]) successfully deleted
I20260807 19:52:45.331960 7602 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.300736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56474 (local address 127.12.155.129:34947)
0807 19:52:45.300921 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.300929 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.300949 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:52:45.301006 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.301012 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.301089 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.301193 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:45.303718 (+ 2525us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.305310 (+ 1592us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.308093 (+ 2783us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.309021 (+ 928us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.309172 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.323832 (+ 14660us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:45.323849 (+ 17us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:45.323867 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:45.323918 (+ 51us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:45.328495 (+ 4577us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.329464 (+ 969us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.329475 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.329478 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.329659 (+ 181us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.330149 (+ 490us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.330155 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.330158 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.330670 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:45.331003 (+ 333us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.331333 (+ 330us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.331567 (+ 234us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:52:45.332739 7131 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:45.424950 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 6908
I20260807 19:52:45.459717 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 7144
I20260807 19:52:45.474661 7595 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.460627 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56998 (local address 127.12.155.130:44957)
0807 19:52:45.460929 (+ 302us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.460935 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.460958 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:52:45.461083 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.461089 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.461166 (+ 77us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.461313 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:45.462752 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.463508 (+ 756us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.465026 (+ 1518us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.465432 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.465579 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.468288 (+ 2709us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:45.468302 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:45.468318 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:45.468353 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:45.471376 (+ 3023us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.472139 (+ 763us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.472147 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.472149 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.472274 (+ 125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.472671 (+ 397us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.472676 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.472679 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.473155 (+ 476us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:45.473470 (+ 315us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.473798 (+ 328us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.474014 (+ 216us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":169}
I20260807 19:52:45.475385 7339 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:45.576874 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 7144
I20260807 19:52:45.604805 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 7360
I20260807 19:52:45.623299 7606 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:52:45.605918 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38244 (local address 127.12.155.131:35765)
0807 19:52:45.606191 (+ 273us) server_negotiation.cc:206] Beginning negotiation
0807 19:52:45.606201 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:52:45.606232 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:52:45.606413 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:52:45.606421 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:52:45.606530 (+ 109us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:52:45.606695 (+ 165us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:52:45.608382 (+ 1687us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.609801 (+ 1419us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.612096 (+ 2295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:52:45.612611 (+ 515us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:52:45.612735 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:52:45.616773 (+ 4038us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:52:45.616795 (+ 22us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:52:45.616813 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:52:45.616861 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:52:45.620076 (+ 3215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.620988 (+ 912us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.620996 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.620998 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.621175 (+ 177us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:52:45.621652 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:52:45.621655 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:52:45.621657 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:52:45.621996 (+ 339us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:52:45.622450 (+ 454us) server_negotiation.cc:1035] Waiting for connection context
0807 19:52:45.622803 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 19:52:45.622979 (+ 176us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":87}
I20260807 19:52:45.624325 7558 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:45.748505 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 7360
I20260807 19:52:45.782745 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 6796
I20260807 19:52:45.784010 6900 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:52:45.900832 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 6796
I20260807 19:53:05.933849 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43061
--webserver_interface=127.12.155.190
--webserver_port=42249
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43061
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20 with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:06.287425 7655 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:06.287779 7655 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:06.287945 7655 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:06.295359 7655 flags.cc:425] Enabled experimental flag: --authn_token_validity_seconds=20
W20260807 19:53:06.295504 7655 flags.cc:425] Enabled experimental flag: --authz_token_validity_seconds=20
W20260807 19:53:06.295598 7655 flags.cc:425] Enabled experimental flag: --tsk_rotation_seconds=20
W20260807 19:53:06.295675 7655 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:06.295758 7655 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:06.295857 7655 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:06.295960 7655 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:06.296046 7655 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:06.306042 7655 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
--authn_token_validity_seconds=20
--authz_token_validity_seconds=20
--tsk_rotation_seconds=20
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43061
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43061
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=42249
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:06.307389 7655 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:06.308764 7655 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:06.321419 7662 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:06.321476 7664 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:06.321564 7668 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:06.327466 7655 server_base.cc:1034] running on GCE node
I20260807 19:53:06.328276 7655 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:06.329730 7655 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:06.331065 7655 hybrid_clock.cc:648] HybridClock initialized: now 1786132386330986 us; error 35 us; skew 500 ppm
I20260807 19:53:06.331422 7655 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:06 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132386, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:06.337831 7655 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:53:06.339607 7655 webserver.cc:460] Webserver started at http://127.12.155.190:42249/ using document root <none> and password file <none>
I20260807 19:53:06.340446 7655 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:06.340621 7655 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:06.346824 7655 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:53:06.349768 7682 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:06.351392 7655 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:53:06.351658 7655 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "7b0110de43704a04b4001484da807d5c"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "f0d6300b4bce2f6d9d04bbd6a2e5cfa4"
server_key_iv: "3bcd366b33c3b8fa903a254466f47c45"
server_key_version: "encryptionkey@0"
I20260807 19:53:06.352734 7655 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:06.374255 7655 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:06.378931 7655 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:06.379267 7655 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:06.400853 7655 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43061
I20260807 19:53:06.400892 7762 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43061 every 8 connection(s)
I20260807 19:53:06.402501 7655 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:06.406354 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 7655
I20260807 19:53:06.407462 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:34947
--local_ip_for_outbound_sockets=127.12.155.129
--tserver_master_addrs=127.12.155.190:43061
--webserver_port=46087
--webserver_interface=127.12.155.129
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:53:06.411181 7763 sys_catalog.cc:263] Verifying existing consensus state
I20260807 19:53:06.416473 7763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap starting.
I20260807 19:53:06.438618 7763 log.cc:824] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:06.455044 7763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap replayed 1/1 log segments. Stats: ops{read=14 overwritten=0 applied=14 ignored=0} inserts{seen=8 ignored=0} mutations{seen=8 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20260807 19:53:06.455607 7763 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Bootstrap complete.
I20260807 19:53:06.467846 7763 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:53:06.469262 7763 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7b0110de43704a04b4001484da807d5c, State: Initialized, Role: FOLLOWER
I20260807 19:53:06.470088 7763 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:53:06.470427 7763 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:06.470572 7763 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:06.470808 7763 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 2 FOLLOWER]: Advancing to term 3
I20260807 19:53:06.476332 7763 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:53:06.476948 7763 leader_election.cc:302] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7b0110de43704a04b4001484da807d5c; no voters:
I20260807 19:53:06.477758 7763 leader_election.cc:288] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [CANDIDATE]: Term 3 election: Requested vote from peers
I20260807 19:53:06.477993 7770 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 3 FOLLOWER]: Leader election won for term 3
I20260807 19:53:06.478797 7770 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [term 3 LEADER]: Becoming Leader. State: Replica: 7b0110de43704a04b4001484da807d5c, State: Running, Role: LEADER
I20260807 19:53:06.479511 7770 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 14, Committed index: 14, Last appended: 2.14, Last appended by leader: 14, Current term: 3, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } }
I20260807 19:53:06.481457 7770 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7b0110de43704a04b4001484da807d5c. Latest consensus state: current_term: 3 leader_uuid: "7b0110de43704a04b4001484da807d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } } }
I20260807 19:53:06.481796 7770 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:06.482282 7772 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 3 leader_uuid: "7b0110de43704a04b4001484da807d5c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7b0110de43704a04b4001484da807d5c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43061 } } }
I20260807 19:53:06.482632 7772 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:06.487115 7763 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:06.490255 7774 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:06.499544 7774 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:06.501109 7774 catalog_manager.cc:1259] Loaded cluster ID: 4db9700a9ec04ebd981575be2303facb
I20260807 19:53:06.501212 7774 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:06.508184 7774 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:06.509963 7774 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Loaded TSK: 0
I20260807 19:53:06.510129 7774 catalog_manager.cc:5879] T 00000000000000000000000000000000 P 7b0110de43704a04b4001484da807d5c: Loaded TSK: 1
F20260807 19:53:06.511298 7774 token_signing_key.cc:66] Check failed: _s.ok() Bad status: Runtime error: unable to load data from memory: error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=RSA error:04093004:rsa routines:OLD_RSA_PRIV_DECODE:RSA lib:rsa_ameth.c:121 error:0D0680A8:asn1 encoding routines:ASN1_CHECK_TLEN:wrong tag:tasn_dec.c:1220 error:0D06C03A:asn1 encoding routines:ASN1_D2I_EX_PRIMITIVE:nested asn1 error:tasn_dec.c:788 error:0D08303A:asn1 encoding routines:ASN1_TEMPLATE_NOEXP_D2I:nested asn1 error:tasn_dec.c:720:Field=version, Type=PKCS8_PRIV_KEY_INFO
*** Check failure stack trace: ***
@ 0x7fa0a0c859ad google::LogMessage::Fail() at ??:0
@ 0x7fa0a0c8888a google::LogMessage::SendToLog() at ??:0
@ 0x7fa0a0c854de google::LogMessage::Flush() at ??:0
@ 0x7fa0a0c86a19 google::LogMessageFatal::~LogMessageFatal() at ??:0
@ 0x7fa0a49e97d2 kudu::security::TokenSigningPrivateKey::TokenSigningPrivateKey() at ??:0
@ 0x7fa0a49d873e kudu::security::TokenSigner::ImportKeys() at ??:0
@ 0x7fa0b66b41c0 kudu::master::CatalogManager::LoadTskEntries() at ??:0
@ 0x7fa0b66b3783 kudu::master::CatalogManager::InitTokenSigner() at ??:0
@ 0x7fa0b673f2a7 kudu::master::CatalogManager::PrepareForLeadershipTask()::$_10::operator()() at ??:0
@ 0x7fa0b673f0c4 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x7fa0b67895e9 std::function<>::operator()() at ??:0
@ 0x7fa0b66b7cdd kudu::master::CatalogManager::PrepareForLeadershipTask()::$_6::operator()() at ??:0
@ 0x7fa0b66b5c36 kudu::master::CatalogManager::PrepareForLeadershipTask() at ??:0
@ 0x7fa0b673d610 kudu::master::CatalogManager::ElectedAsLeaderCb()::$_2::operator()() at ??:0
@ 0x7fa0b673d439 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fa0a38d1345 kudu::ThreadPool::DispatchThread() at ??:0
@ 0x7fa0a38d491c kudu::ThreadPool::CreateThread()::$_2::operator()() at ??:0
@ 0x7fa0a38d4799 std::_Function_handler<>::_M_invoke() at ??:0
@ 0x9edb7d std::function<>::operator()() at ??:?
@ 0x7fa0a38afeaf kudu::Thread::SuperviseThread() at ??:0
@ 0x7fa0a6b896db start_thread at ??:0
@ 0x7fa09fb1f61f clone at ??:0
W20260807 19:53:06.891021 7767 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:06.891304 7767 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:06.891460 7767 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:06.899011 7767 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:06.899122 7767 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:06.899292 7767 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:06.909235 7767 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:34947
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=46087
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:06.910609 7767 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:06.911944 7767 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:06.925688 7843 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:06.925740 7838 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:06.925791 7836 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:06.931668 7767 server_base.cc:1034] running on GCE node
I20260807 19:53:06.932345 7767 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:06.933382 7767 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:06.934614 7767 hybrid_clock.cc:648] HybridClock initialized: now 1786132386934540 us; error 65 us; skew 500 ppm
I20260807 19:53:06.934948 7767 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:06 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132386, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:06.938233 7767 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:53:06.939752 7767 webserver.cc:460] Webserver started at http://127.12.155.129:46087/ using document root <none> and password file <none>
I20260807 19:53:06.940502 7767 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:06.940659 7767 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:06.945983 7767 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:06.948717 7855 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:06.950237 7767 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 19:53:06.950428 7767 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "67b99618179f4586a49e1f32d21e7187"
format_stamp: "Formatted at 2026-08-07 19:52:20 on dist-test-slave-2p8l"
server_key: "cf0b8c0880fe76934827a455b7ad70d1"
server_key_iv: "63ec50e90ab9589ea468bfcfcf56b1a3"
server_key_version: "encryptionkey@0"
I20260807 19:53:06.951429 7767 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:06.976635 7767 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:06.980832 7767 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:06.981132 7767 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:06.982275 7767 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:06.983758 7767 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:06.983891 7767 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:06.984033 7767 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:06.984131 7767 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.018308 7767 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:34947
I20260807 19:53:07.018400 8048 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:34947 every 8 connection(s)
I20260807 19:53:07.019829 7767 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:07.024528 8055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.022699 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:34683)
0807 19:53:07.023425 (+ 726us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.023696 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":484,"thread_start_us":280,"threads_started":1}
W20260807 19:53:07.025144 8050 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:43061 (0 consecutive failures): Network error: Failed to ping master at 127.12.155.190:43061: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
I20260807 19:53:07.025926 8055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.025625 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:44601)
0807 19:53:07.025765 (+ 140us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.025828 (+ 63us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 19:53:07.026460 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 7767
I20260807 19:53:07.026927 8055 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.026621 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:58295)
0807 19:53:07.026756 (+ 135us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.026825 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:53:07.027225 8050 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:53:07.027248 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:44957
--local_ip_for_outbound_sockets=127.12.155.130
--tserver_master_addrs=127.12.155.190:43061
--webserver_port=44225
--webserver_interface=127.12.155.130
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:07.373494 8057 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:07.373828 8057 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:07.374006 8057 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:07.381290 8057 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:07.381450 8057 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:07.381634 8057 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:07.391479 8057 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:44957
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=44225
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:07.392784 8057 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:07.394187 8057 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:07.407604 8069 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:07.407691 8067 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:07.407691 8066 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:07.408793 8057 server_base.cc:1034] running on GCE node
I20260807 19:53:07.409425 8057 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:07.410451 8057 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:07.411664 8057 hybrid_clock.cc:648] HybridClock initialized: now 1786132387411607 us; error 48 us; skew 500 ppm
I20260807 19:53:07.411993 8057 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:07 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132387, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:07.415482 8057 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:53:07.417038 8057 webserver.cc:460] Webserver started at http://127.12.155.130:44225/ using document root <none> and password file <none>
I20260807 19:53:07.417784 8057 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:07.417929 8057 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:07.423364 8057 fs_manager.cc:709] Time spent opening directory manager: real 0.003s user 0.001s sys 0.003s
I20260807 19:53:07.426323 8082 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.427685 8057 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:53:07.427863 8057 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "0e7a07e94fa94e85bc8cc05429895f1d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "696aa4c7b175eb79a36603f44a9b3de4"
server_key_iv: "44fe4dbd73929807d715bffd682bf287"
server_key_version: "encryptionkey@0"
I20260807 19:53:07.428845 8057 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:07.446902 8057 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:07.450789 8057 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:07.451079 8057 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:07.452047 8057 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:07.453363 8057 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:07.453491 8057 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.453645 8057 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:07.453733 8057 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.488425 8057 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:44957
I20260807 19:53:07.488590 8262 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:44957 every 8 connection(s)
I20260807 19:53:07.489921 8057 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:07.495072 8266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.493147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:54241)
0807 19:53:07.493920 (+ 773us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.494229 (+ 309us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":526,"thread_start_us":306,"threads_started":1}
W20260807 19:53:07.495813 8263 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:43061 (0 consecutive failures): Network error: Failed to ping master at 127.12.155.190:43061: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
I20260807 19:53:07.496587 8266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.496260 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:50933)
0807 19:53:07.496399 (+ 139us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.496474 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 19:53:07.496872 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 8057
I20260807 19:53:07.497543 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:35765
--local_ip_for_outbound_sockets=127.12.155.131
--tserver_master_addrs=127.12.155.190:43061
--webserver_port=36949
--webserver_interface=127.12.155.131
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:35717
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:53:07.497764 8266 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.497247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:59707)
0807 19:53:07.497416 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.497587 (+ 171us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 19:53:07.498096 8263 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
W20260807 19:53:07.837306 8267 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:07.837644 8267 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:07.837826 8267 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:07.844947 8267 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:07.845112 8267 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:07.845310 8267 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:07.855134 8267 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:35717
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:35765
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=36949
--tserver_master_addrs=127.12.155.190:43061
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:07.856624 8267 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:07.857985 8267 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:07.871873 8272 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:07.871824 8277 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:07.871919 8275 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:07.872825 8267 server_base.cc:1034] running on GCE node
I20260807 19:53:07.873400 8267 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:07.874334 8267 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:07.875572 8267 hybrid_clock.cc:648] HybridClock initialized: now 1786132387875506 us; error 64 us; skew 500 ppm
I20260807 19:53:07.875900 8267 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:07 dist-test-slave-2p8l krb5kdc[5913](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132387, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:07.879122 8267 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:53:07.880561 8267 webserver.cc:460] Webserver started at http://127.12.155.131:36949/ using document root <none> and password file <none>
I20260807 19:53:07.881193 8267 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:07.881295 8267 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:07.886837 8267 fs_manager.cc:709] Time spent opening directory manager: real 0.004s user 0.002s sys 0.001s
I20260807 19:53:07.889596 8293 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.891028 8267 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:53:07.891227 8267 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "8bae997f34414435a0d90c5bcc16ba7d"
format_stamp: "Formatted at 2026-08-07 19:52:21 on dist-test-slave-2p8l"
server_key: "0e0ccbec5ab2f7fa5c6dcdc094094226"
server_key_iv: "06d2eded752c1330080434a1c188c701"
server_key_version: "encryptionkey@0"
I20260807 19:53:07.892184 8267 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:07.904178 8267 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:07.908496 8267 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:07.908792 8267 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:07.909793 8267 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:07.911173 8267 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:07.911259 8267 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.911417 8267 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:07.911509 8267 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:07.945533 8267 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:35765
I20260807 19:53:07.945688 8478 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:35765 every 8 connection(s)
I20260807 19:53:07.947283 8267 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.SecurityITest.TestEnableAndDisableEncryptedTSK.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:07.952405 8483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.950432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:58131)
0807 19:53:07.951209 (+ 777us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.951441 (+ 232us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":508,"thread_start_us":301,"threads_started":1}
W20260807 19:53:07.953202 8480 heartbeater.cc:644] Failed to heartbeat to 127.12.155.190:43061 (0 consecutive failures): Network error: Failed to ping master at 127.12.155.190:43061: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
I20260807 19:53:07.954157 8483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.953731 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:48407)
0807 19:53:07.953902 (+ 171us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.953974 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:53:07.955094 8483 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:07.954746 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:53581)
0807 19:53:07.954853 (+ 107us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:07.954977 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":28}
W20260807 19:53:07.955334 8480 heartbeater.cc:415] Failed 3 heartbeats in a row: no longer allowing fast heartbeat attempts.
I20260807 19:53:07.956233 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 8267
I20260807 19:53:08.028477 8487 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:08.027721 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:41235)
0807 19:53:08.028163 (+ 442us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:08.028249 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":219,"threads_started":1}
I20260807 19:53:08.499490 8488 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:08.498614 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:52193)
0807 19:53:08.499122 (+ 508us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:08.499233 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":237,"threads_started":1}
I20260807 19:53:08.956645 8489 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:08.955865 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:53807)
0807 19:53:08.956327 (+ 462us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:08.956411 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":360,"thread_start_us":232,"threads_started":1}
I20260807 19:53:09.030393 8490 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:09.029516 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:59717)
0807 19:53:09.030021 (+ 505us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:09.030213 (+ 192us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":387,"thread_start_us":246,"threads_started":1}
I20260807 19:53:09.501276 8491 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:09.500512 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:60607)
0807 19:53:09.500979 (+ 467us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:09.501059 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":363,"thread_start_us":225,"threads_started":1}
I20260807 19:53:09.958390 8495 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:09.957595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:42709)
0807 19:53:09.958126 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:09.958219 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":376,"thread_start_us":239,"threads_started":1}
I20260807 19:53:10.032002 8496 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:10.031309 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:59145)
0807 19:53:10.031744 (+ 435us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:10.031825 (+ 81us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":337,"thread_start_us":224,"threads_started":1}
I20260807 19:53:10.503031 8498 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:10.502269 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:40501)
0807 19:53:10.502776 (+ 507us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:10.502856 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":405,"thread_start_us":256,"threads_started":1}
I20260807 19:53:10.960134 8499 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:10.959338 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:54375)
0807 19:53:10.959850 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:10.959940 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":277,"threads_started":1}
I20260807 19:53:11.033865 8501 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:11.033044 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:38917)
0807 19:53:11.033571 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:11.033687 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":292,"threads_started":1}
I20260807 19:53:11.504700 8502 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:11.503920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:46071)
0807 19:53:11.504379 (+ 459us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:11.504479 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":351,"thread_start_us":234,"threads_started":1}
I20260807 19:53:11.961925 8503 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:11.961120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:46385)
0807 19:53:11.961631 (+ 511us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:11.961721 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":258,"threads_started":1}
I20260807 19:53:12.035852 8504 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:12.034959 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:32917)
0807 19:53:12.035537 (+ 578us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:12.035635 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":309,"threads_started":1}
I20260807 19:53:12.506458 8505 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:12.505666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:49113)
0807 19:53:12.506199 (+ 533us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:12.506285 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":375,"thread_start_us":231,"threads_started":1}
I20260807 19:53:12.963831 8507 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:12.963004 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:47331)
0807 19:53:12.963535 (+ 531us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:12.963643 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":418,"thread_start_us":279,"threads_started":1}
I20260807 19:53:13.037545 8508 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:13.036769 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:59179)
0807 19:53:13.037281 (+ 512us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:13.037378 (+ 97us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":403,"thread_start_us":263,"threads_started":1}
I20260807 19:53:13.508533 8509 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:13.507529 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:48925)
0807 19:53:13.508180 (+ 651us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:13.508310 (+ 130us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":465,"thread_start_us":342,"threads_started":1}
I20260807 19:53:13.965556 8510 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:13.964814 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:42233)
0807 19:53:13.965291 (+ 477us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:13.965384 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":378,"thread_start_us":262,"threads_started":1}
I20260807 19:53:14.039448 8511 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:14.038560 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:38701)
0807 19:53:14.039148 (+ 588us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:14.039234 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":455,"thread_start_us":279,"threads_started":1}
I20260807 19:53:14.510579 8513 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:14.509632 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:50967)
0807 19:53:14.510232 (+ 600us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:14.510318 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":411,"thread_start_us":233,"threads_started":1}
I20260807 19:53:14.967648 8515 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:14.966707 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:47821)
0807 19:53:14.967234 (+ 527us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:14.967335 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":417,"thread_start_us":237,"threads_started":1}
I20260807 19:53:15.041244 8517 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:15.040443 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:38267)
0807 19:53:15.040977 (+ 534us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:15.041069 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":431,"thread_start_us":305,"threads_started":1}
I20260807 19:53:15.512399 8518 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:15.511588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:49809)
0807 19:53:15.512125 (+ 537us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:15.512217 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":419,"thread_start_us":277,"threads_started":1}
I20260807 19:53:15.969455 8519 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:15.968655 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:50509)
0807 19:53:15.969179 (+ 524us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:15.969273 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":407,"thread_start_us":262,"threads_started":1}
I20260807 19:53:16.043138 8521 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:16.042362 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:55931)
0807 19:53:16.042861 (+ 499us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:16.042944 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":391,"thread_start_us":244,"threads_started":1}
I20260807 19:53:16.514487 8522 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:16.513468 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:50201)
0807 19:53:16.514035 (+ 567us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:16.514290 (+ 255us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":449,"thread_start_us":290,"threads_started":1}
I20260807 19:53:16.971457 8524 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:16.970691 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:47195)
0807 19:53:16.971194 (+ 503us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:16.971279 (+ 85us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":397,"thread_start_us":248,"threads_started":1}
I20260807 19:53:17.044853 8525 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:17.044097 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:39817)
0807 19:53:17.044568 (+ 471us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:17.044684 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":377,"thread_start_us":250,"threads_started":1}
I20260807 19:53:17.516386 8526 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:17.515432 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:55901)
0807 19:53:17.516128 (+ 696us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:17.516212 (+ 84us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":588,"thread_start_us":472,"threads_started":1}
I20260807 19:53:17.973371 8528 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:17.972586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:34839)
0807 19:53:17.973101 (+ 515us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:17.973194 (+ 93us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":260,"threads_started":1}
I20260807 19:53:18.046860 8529 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:18.045914 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:53883)
0807 19:53:18.046511 (+ 597us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:18.046626 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":473,"thread_start_us":334,"threads_started":1}
I20260807 19:53:18.518671 8533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:18.517700 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:37891)
0807 19:53:18.518314 (+ 614us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:18.518422 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":491,"thread_start_us":266,"threads_started":1}
I20260807 19:53:18.975360 8535 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:18.974517 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:45425)
0807 19:53:18.975088 (+ 571us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:18.975179 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":438,"thread_start_us":282,"threads_started":1}
I20260807 19:53:19.048988 8537 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:19.048133 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:56611)
0807 19:53:19.048726 (+ 593us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:19.048827 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":279,"threads_started":1}
I20260807 19:53:19.520421 8538 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:19.519720 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:51403)
0807 19:53:19.520177 (+ 457us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:19.520259 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":350,"thread_start_us":235,"threads_started":1}
I20260807 19:53:19.977517 8541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:19.976611 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:36615)
0807 19:53:19.977187 (+ 576us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:19.977287 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":436,"thread_start_us":289,"threads_started":1}
I20260807 19:53:20.051020 8542 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:20.049998 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:50975)
0807 19:53:20.050721 (+ 723us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:20.050823 (+ 102us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":439,"threads_started":1}
I20260807 19:53:20.522425 8544 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:20.521455 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:42743)
0807 19:53:20.522037 (+ 582us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:20.522215 (+ 178us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":475,"thread_start_us":319,"threads_started":1}
I20260807 19:53:20.979681 8545 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:20.978756 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:52713)
0807 19:53:20.979320 (+ 564us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:20.979461 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":441,"thread_start_us":274,"threads_started":1}
I20260807 19:53:21.053483 8547 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:21.052214 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:56339)
0807 19:53:21.053021 (+ 807us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:21.053183 (+ 162us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":633,"thread_start_us":421,"threads_started":1}
I20260807 19:53:21.524284 8548 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:21.523488 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:47049)
0807 19:53:21.523983 (+ 495us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:21.524091 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":382,"thread_start_us":257,"threads_started":1}
I20260807 19:53:21.981734 8549 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:21.980898 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:43039)
0807 19:53:21.981427 (+ 529us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:21.981538 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":413,"thread_start_us":263,"threads_started":1}
I20260807 19:53:22.055872 8551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:22.055012 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:59227)
0807 19:53:22.055513 (+ 501us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:22.055656 (+ 143us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":380,"thread_start_us":237,"threads_started":1}
I20260807 19:53:22.526562 8555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:22.525670 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.130:55871)
0807 19:53:22.526249 (+ 579us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:22.526355 (+ 106us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":459,"thread_start_us":269,"threads_started":1}
I20260807 19:53:22.958549 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 7767
I20260807 19:53:22.984609 8558 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:22.959859 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60008 (local address 127.12.155.129:34947)
0807 19:53:22.960715 (+ 856us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:22.960738 (+ 23us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:22.960789 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:53:22.962533 (+ 1744us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:22.962544 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:22.962973 (+ 429us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:22.963269 (+ 296us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:22.964885 (+ 1616us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:22.966276 (+ 1391us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:22.967773 (+ 1497us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:22.968488 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:22.968694 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:22.977406 (+ 8712us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:22.977416 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:22.977434 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:22.977486 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:22.980655 (+ 3169us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:22.981441 (+ 786us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:22.981448 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:22.981455 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:22.981669 (+ 214us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:22.982285 (+ 616us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:22.982290 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:22.982293 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:22.983067 (+ 774us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:22.983314 (+ 247us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:22.983901 (+ 587us) server_negotiation.cc:299] Negotiation successful
0807 19:53:22.984247 (+ 346us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":610,"thread_start_us":453,"threads_started":1}
I20260807 19:53:22.985319 8559 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:22.983111 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.131:43449)
0807 19:53:22.984958 (+ 1847us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:22.985108 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":1689,"thread_start_us":1578,"threads_started":1}
I20260807 19:53:22.986467 8043 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:23.078388 8561 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:23.077127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:43061 (local address 127.12.155.129:48025)
0807 19:53:23.077739 (+ 612us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:23.078010 (+ 271us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.190:43061: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":466,"thread_start_us":287,"threads_started":1}
I20260807 19:53:23.082280 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 7767
I20260807 19:53:23.107980 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 8057
I20260807 19:53:23.126281 8566 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:23.108980 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50534 (local address 127.12.155.130:44957)
0807 19:53:23.109478 (+ 498us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:23.109492 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:23.109531 (+ 39us) server_negotiation.cc:407] Connection header received
0807 19:53:23.111107 (+ 1576us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:23.111119 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:23.111549 (+ 430us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:23.111843 (+ 294us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:23.113244 (+ 1401us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:23.114777 (+ 1533us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:23.116114 (+ 1337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:23.116934 (+ 820us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:23.117088 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:23.120103 (+ 3015us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:23.120111 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:23.120128 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:23.120168 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:23.123218 (+ 3050us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:23.123864 (+ 646us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:23.123871 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:23.123877 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:23.124050 (+ 173us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:23.124377 (+ 327us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:23.124380 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:23.124382 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:23.124894 (+ 512us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:23.125112 (+ 218us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:23.125486 (+ 374us) server_negotiation.cc:299] Negotiation successful
0807 19:53:23.125858 (+ 372us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":343,"thread_start_us":224,"threads_started":1}
I20260807 19:53:23.127691 8257 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:23.211184 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 8057
I20260807 19:53:23.238291 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 8267
I20260807 19:53:23.257244 8570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:23.239412 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54828 (local address 127.12.155.131:35765)
0807 19:53:23.240084 (+ 672us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:23.240100 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:23.240146 (+ 46us) server_negotiation.cc:407] Connection header received
0807 19:53:23.241871 (+ 1725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:23.241881 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:23.242587 (+ 706us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:23.242951 (+ 364us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:23.244446 (+ 1495us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:23.245689 (+ 1243us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:23.247174 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:23.247818 (+ 644us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:23.248024 (+ 206us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:23.250843 (+ 2819us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:23.250851 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:23.250866 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:23.250909 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:23.253781 (+ 2872us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:23.254577 (+ 796us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:23.254589 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:23.254596 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:23.254758 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:23.255179 (+ 421us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:23.255182 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:23.255185 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:23.255755 (+ 570us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:23.256071 (+ 316us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:23.256524 (+ 453us) server_negotiation.cc:299] Negotiation successful
0807 19:53:23.256944 (+ 420us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":504,"thread_start_us":337,"threads_started":1}
I20260807 19:53:23.258678 8473 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:23.344113 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 8267
2026-08-07T19:53:23Z chronyd exiting
[ OK ] SecurityITest.TestEnableAndDisableEncryptedTSK (65160 ms)
[----------] 30 tests from SecurityITest (329893 ms total)
[----------] 6 tests from EncryptionPolicyTest
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/0
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:23 dist-test-slave-2p8l krb5kdc[8578](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:23 dist-test-slave-2p8l krb5kdc[8578](info): set up 2 sockets
Aug 07 19:53:23 dist-test-slave-2p8l krb5kdc[8578](info): commencing operation
krb5kdc: starting...
W20260807 19:53:24.709131 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.004s sys 0.038s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:24 dist-test-slave-2p8l krb5kdc[8578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:24Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:24Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:53:25.023754 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:37163
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:37163
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:25.364863 8595 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:25.365160 8595 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:25.365343 8595 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:25.372634 8595 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:25.372735 8595 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:25.372843 8595 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:25.372946 8595 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:25.373049 8595 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:25.383612 8595 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:37163
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:37163
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:25.384961 8595 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:25.386337 8595 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:25.398551 8602 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:25.398628 8603 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:25.398665 8605 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:25.399323 8595 server_base.cc:1034] running on GCE node
I20260807 19:53:25.400106 8595 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:25.401515 8595 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:25.402730 8595 hybrid_clock.cc:648] HybridClock initialized: now 1786132405402681 us; error 34 us; skew 500 ppm
I20260807 19:53:25.403090 8595 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:25 dist-test-slave-2p8l krb5kdc[8578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132405, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:25.406363 8595 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:53:25.408038 8595 webserver.cc:460] Webserver started at http://127.12.155.190:33925/ using document root <none> and password file <none>
I20260807 19:53:25.408787 8595 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:25.408943 8595 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:25.409265 8595 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:25.412355 8595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "28e3f395a49a41f79705978e88e3d509"
format_stamp: "Formatted at 2026-08-07 19:53:25 on dist-test-slave-2p8l"
server_key: "c4a9cbf0f1037f12ddb1630e35b1a17b"
server_key_iv: "5c1ef9a2e9a4e239bcefbd0f2bd025e2"
server_key_version: "encryptionkey@0"
I20260807 19:53:25.413106 8595 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "28e3f395a49a41f79705978e88e3d509"
format_stamp: "Formatted at 2026-08-07 19:53:25 on dist-test-slave-2p8l"
server_key: "c4a9cbf0f1037f12ddb1630e35b1a17b"
server_key_iv: "5c1ef9a2e9a4e239bcefbd0f2bd025e2"
server_key_version: "encryptionkey@0"
I20260807 19:53:25.418582 8595 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:53:25.422307 8617 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:25.423635 8595 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:25.423849 8595 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "28e3f395a49a41f79705978e88e3d509"
format_stamp: "Formatted at 2026-08-07 19:53:25 on dist-test-slave-2p8l"
server_key: "c4a9cbf0f1037f12ddb1630e35b1a17b"
server_key_iv: "5c1ef9a2e9a4e239bcefbd0f2bd025e2"
server_key_version: "encryptionkey@0"
I20260807 19:53:25.424067 8595 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:25.445122 8595 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:25.449594 8595 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:25.449911 8595 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:25.469902 8595 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:37163
I20260807 19:53:25.469929 8697 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:37163 every 8 connection(s)
I20260807 19:53:25.471402 8595 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:25.472901 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 8595
I20260807 19:53:25.473165 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:25.474048 12910 external_mini_cluster.cc:1428] Setting key ee83e1dadb295538f79b49241f9b8b51
I20260807 19:53:25.476428 8698 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:53:25 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:25.490604 8698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509: Bootstrap starting.
I20260807 19:53:25.493899 8698 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:25.495045 8698 log.cc:824] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:25.498996 8698 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509: No bootstrap required, opened a new log
I20260807 19:53:25.499655 8701 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:25.476237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44282 (local address 127.12.155.190:37163)
0807 19:53:25.477077 (+ 840us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:25.477090 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:25.477131 (+ 41us) server_negotiation.cc:407] Connection header received
0807 19:53:25.478910 (+ 1779us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:25.478932 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:25.479313 (+ 381us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:25.479653 (+ 340us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:25.481549 (+ 1896us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:25.483210 (+ 1661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:25.485165 (+ 1955us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:25.485822 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:25.485960 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:25.491140 (+ 5180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:25.491149 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:25.491163 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:25.491203 (+ 40us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:25.494526 (+ 3323us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:25.495345 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:25.495355 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:25.495364 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:25.495594 (+ 230us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:25.496216 (+ 622us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:25.496220 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:25.496223 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:25.497009 (+ 786us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:25.497331 (+ 322us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:25.497801 (+ 470us) server_negotiation.cc:299] Negotiation successful
0807 19:53:25.498277 (+ 476us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":397,"threads_started":1}
I20260807 19:53:25.507012 8698 raft_consensus.cc:348] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28e3f395a49a41f79705978e88e3d509" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37163 } }
I20260807 19:53:25.507405 8698 raft_consensus.cc:374] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:25.507488 8698 raft_consensus.cc:729] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 28e3f395a49a41f79705978e88e3d509, State: Initialized, Role: FOLLOWER
I20260807 19:53:25.508095 8698 consensus_queue.cc:260] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28e3f395a49a41f79705978e88e3d509" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37163 } }
I20260807 19:53:25.508315 8698 raft_consensus.cc:388] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:25.508482 8698 raft_consensus.cc:482] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:25.508697 8698 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:25.511021 8698 raft_consensus.cc:504] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28e3f395a49a41f79705978e88e3d509" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37163 } }
I20260807 19:53:25.511529 8698 leader_election.cc:302] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 28e3f395a49a41f79705978e88e3d509; no voters:
I20260807 19:53:25.512148 8698 leader_election.cc:288] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:25.512313 8707 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:25.513079 8707 raft_consensus.cc:686] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [term 1 LEADER]: Becoming Leader. State: Replica: 28e3f395a49a41f79705978e88e3d509, State: Running, Role: LEADER
I20260807 19:53:25.513983 8707 consensus_queue.cc:237] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28e3f395a49a41f79705978e88e3d509" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37163 } }
I20260807 19:53:25.514786 8698 sys_catalog.cc:564] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:25.517241 8709 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 28e3f395a49a41f79705978e88e3d509. Latest consensus state: current_term: 1 leader_uuid: "28e3f395a49a41f79705978e88e3d509" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28e3f395a49a41f79705978e88e3d509" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37163 } } }
I20260807 19:53:25.517212 8708 sys_catalog.cc:455] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "28e3f395a49a41f79705978e88e3d509" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "28e3f395a49a41f79705978e88e3d509" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 37163 } } }
I20260807 19:53:25.517678 8709 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:25.517678 8708 sys_catalog.cc:458] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:25.519951 8716 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:25.525842 8716 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:25.534610 8716 catalog_manager.cc:1347] Generated new cluster ID: ff292997731e4e49bd849a2b2adebf06
I20260807 19:53:25.534729 8716 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:25.611541 8716 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:25.613030 8716 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:25.620118 8716 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509: Generated new TSK 0
I20260807 19:53:25.621044 8716 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:53:25.702481 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37163
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:26.053948 8740 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:26.054368 8740 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:26.054549 8740 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:26.062628 8740 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:26.062776 8740 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:26.062968 8740 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:26.072726 8740 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:26.073973 8740 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:26.075299 8740 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:26.088725 8747 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:26.088698 8756 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:26.088798 8748 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:26.089777 8740 server_base.cc:1034] running on GCE node
I20260807 19:53:26.090428 8740 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:26.091367 8740 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:26.092661 8740 hybrid_clock.cc:648] HybridClock initialized: now 1786132406092608 us; error 44 us; skew 500 ppm
I20260807 19:53:26.093044 8740 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:26 dist-test-slave-2p8l krb5kdc[8578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132406, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:26.096707 8740 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:53:26.098320 8740 webserver.cc:460] Webserver started at http://127.12.155.129:33597/ using document root <none> and password file <none>
I20260807 19:53:26.099025 8740 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:26.099182 8740 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:26.099529 8740 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:26.102533 8740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "6f3b5f899a3441cf9faf654e910fd697"
format_stamp: "Formatted at 2026-08-07 19:53:26 on dist-test-slave-2p8l"
server_key: "d02d817c82857bc7fd41f832a9148709"
server_key_iv: "69b2a248f981eb8df4faf2bc17a68e10"
server_key_version: "encryptionkey@0"
I20260807 19:53:26.103314 8740 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "6f3b5f899a3441cf9faf654e910fd697"
format_stamp: "Formatted at 2026-08-07 19:53:26 on dist-test-slave-2p8l"
server_key: "d02d817c82857bc7fd41f832a9148709"
server_key_iv: "69b2a248f981eb8df4faf2bc17a68e10"
server_key_version: "encryptionkey@0"
I20260807 19:53:26.108660 8740 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:53:26.112280 8765 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:26.113652 8740 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.002s
I20260807 19:53:26.113842 8740 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "6f3b5f899a3441cf9faf654e910fd697"
format_stamp: "Formatted at 2026-08-07 19:53:26 on dist-test-slave-2p8l"
server_key: "d02d817c82857bc7fd41f832a9148709"
server_key_iv: "69b2a248f981eb8df4faf2bc17a68e10"
server_key_version: "encryptionkey@0"
I20260807 19:53:26.114042 8740 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:26.152158 8740 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:26.156695 8740 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:26.157016 8740 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:26.158035 8740 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:26.159474 8740 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:26.159605 8740 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:26.159760 8740 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:26.159835 8740 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:26.194309 8740 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:43337
I20260807 19:53:26.194458 8942 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:43337 every 8 connection(s)
I20260807 19:53:26.195650 8740 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:26.204873 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 8740
I20260807 19:53:26.205158 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:53:26.205844 12910 external_mini_cluster.cc:1428] Setting key fa07ab56a8af51edd76bd218833ead23
Aug 07 19:53:26 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132406, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:26.217000 8948 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:26.198253 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:57377 (local address 127.12.155.190:37163)
0807 19:53:26.198743 (+ 490us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:26.198750 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:26.199731 (+ 981us) server_negotiation.cc:407] Connection header received
0807 19:53:26.201565 (+ 1834us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:26.201570 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:26.201644 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:26.201757 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:26.203283 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.204015 (+ 732us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.205831 (+ 1816us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.206380 (+ 549us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.206538 (+ 158us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:26.210799 (+ 4261us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:26.210804 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:26.210807 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:26.210837 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:26.213487 (+ 2650us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:26.214502 (+ 1015us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:26.214507 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:26.214509 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:26.214639 (+ 130us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:26.215146 (+ 507us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:26.215150 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:26.215152 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:26.215473 (+ 321us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:26.215631 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:26.216558 (+ 927us) server_negotiation.cc:299] Negotiation successful
0807 19:53:26.216735 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":354,"thread_start_us":221,"threads_started":1}
I20260807 19:53:26.218613 8949 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:26.198858 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37163 (local address 127.12.155.129:57377)
0807 19:53:26.199556 (+ 698us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:26.199593 (+ 37us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:26.201299 (+ 1706us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:26.201956 (+ 657us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:26.201963 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:26.202545 (+ 582us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:26.203113 (+ 568us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:26.203135 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.204190 (+ 1055us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.204194 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:26.205660 (+ 1466us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:26.205674 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.206639 (+ 965us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.206648 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:26.206926 (+ 278us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:26.207679 (+ 753us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:26.207703 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:26.210529 (+ 2826us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:26.213639 (+ 3110us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:26.213651 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:26.213670 (+ 19us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:26.214352 (+ 682us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:26.214754 (+ 402us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:26.214761 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:26.214767 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:26.215020 (+ 253us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:26.215638 (+ 618us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:26.215649 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:26.216112 (+ 463us) client_negotiation.cc:769] Sending connection context
0807 19:53:26.216451 (+ 339us) client_negotiation.cc:240] Negotiation successful
0807 19:53:26.217037 (+ 586us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":462,"thread_start_us":278,"threads_started":1}
I20260807 19:53:26.220230 8945 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37163
I20260807 19:53:26.220582 8945 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:26.221448 8945 heartbeater.cc:511] Master 127.12.155.190:37163 requested a full tablet report, sending...
I20260807 19:53:26.223585 8654 ts_manager.cc:194] Registered new tserver with Master: 6f3b5f899a3441cf9faf654e910fd697 (127.12.155.129:43337)
I20260807 19:53:26.225028 8654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:57377
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:53:26.272938 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37163
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:26.619900 8954 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:26.620184 8954 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:26.620389 8954 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:26.627774 8954 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:26.627877 8954 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:26.628080 8954 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:26.637696 8954 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:26.638976 8954 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:26.640273 8954 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:26.654194 8959 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:26.654124 8965 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:26.654229 8960 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:26.655052 8954 server_base.cc:1034] running on GCE node
I20260807 19:53:26.655784 8954 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:26.656828 8954 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:26.658165 8954 hybrid_clock.cc:648] HybridClock initialized: now 1786132406658103 us; error 75 us; skew 500 ppm
I20260807 19:53:26.658504 8954 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:26 dist-test-slave-2p8l krb5kdc[8578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132406, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:26.665380 8954 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:53:26.666970 8954 webserver.cc:460] Webserver started at http://127.12.155.130:45195/ using document root <none> and password file <none>
I20260807 19:53:26.667666 8954 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:26.667819 8954 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:26.668146 8954 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:26.671101 8954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "0153d50ddd974025acca12343ff5b921"
format_stamp: "Formatted at 2026-08-07 19:53:26 on dist-test-slave-2p8l"
server_key: "7465cbaf24dac4a26c2dadab7eaba9ee"
server_key_iv: "53150a291f72e9f14704f6e0ca2dd27b"
server_key_version: "encryptionkey@0"
I20260807 19:53:26.671882 8954 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "0153d50ddd974025acca12343ff5b921"
format_stamp: "Formatted at 2026-08-07 19:53:26 on dist-test-slave-2p8l"
server_key: "7465cbaf24dac4a26c2dadab7eaba9ee"
server_key_iv: "53150a291f72e9f14704f6e0ca2dd27b"
server_key_version: "encryptionkey@0"
I20260807 19:53:26.677019 8954 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:53:26.680570 8976 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:26.681949 8954 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.001s
I20260807 19:53:26.682183 8954 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "0153d50ddd974025acca12343ff5b921"
format_stamp: "Formatted at 2026-08-07 19:53:26 on dist-test-slave-2p8l"
server_key: "7465cbaf24dac4a26c2dadab7eaba9ee"
server_key_iv: "53150a291f72e9f14704f6e0ca2dd27b"
server_key_version: "encryptionkey@0"
I20260807 19:53:26.682399 8954 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:26.706418 8954 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:26.715446 8954 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:26.715802 8954 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:26.716987 8954 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:26.718953 8954 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:26.719080 8954 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:26.719285 8954 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:26.719362 8954 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:26.761494 8954 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:42683
I20260807 19:53:26.761687 9170 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:42683 every 8 connection(s)
I20260807 19:53:26.763221 8954 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:26.773020 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 8954
I20260807 19:53:26.773236 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:53:26.773733 12910 external_mini_cluster.cc:1428] Setting key 5e4fe1850ef0ee8846078781548183c4
Aug 07 19:53:26 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132406, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:26.785894 9173 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:26.766448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:41023 (local address 127.12.155.190:37163)
0807 19:53:26.767070 (+ 622us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:26.767075 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:26.768063 (+ 988us) server_negotiation.cc:407] Connection header received
0807 19:53:26.769913 (+ 1850us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:26.769919 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:26.770009 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:26.770200 (+ 191us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:26.771681 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.772389 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.774249 (+ 1860us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.774861 (+ 612us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.775007 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:26.779035 (+ 4028us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:26.779041 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:26.779044 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:26.779078 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:26.781883 (+ 2805us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:26.782749 (+ 866us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:26.782756 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:26.782760 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:26.782912 (+ 152us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:26.783441 (+ 529us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:26.783446 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:26.783455 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:26.783767 (+ 312us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:26.783947 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:26.785153 (+ 1206us) server_negotiation.cc:299] Negotiation successful
0807 19:53:26.785423 (+ 270us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":452,"thread_start_us":272,"threads_started":1}
I20260807 19:53:26.786664 9174 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:26.767106 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37163 (local address 127.12.155.130:41023)
0807 19:53:26.767853 (+ 747us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:26.767925 (+ 72us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:26.769658 (+ 1733us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:26.770386 (+ 728us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:26.770394 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:26.770963 (+ 569us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:26.771508 (+ 545us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:26.771537 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.772554 (+ 1017us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.772558 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:26.774027 (+ 1469us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:26.774040 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:26.775112 (+ 1072us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:26.775120 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:26.775367 (+ 247us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:26.776312 (+ 945us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:26.776335 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:26.778797 (+ 2462us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:26.782092 (+ 3295us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:26.782103 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:26.782120 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:26.782597 (+ 477us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:26.783066 (+ 469us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:26.783072 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:26.783076 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:26.783293 (+ 217us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:26.783916 (+ 623us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:26.783924 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:26.784310 (+ 386us) client_negotiation.cc:769] Sending connection context
0807 19:53:26.784592 (+ 282us) client_negotiation.cc:240] Negotiation successful
0807 19:53:26.785170 (+ 578us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":286,"threads_started":1}
I20260807 19:53:26.788194 9171 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37163
I20260807 19:53:26.788563 9171 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:26.789374 9171 heartbeater.cc:511] Master 127.12.155.190:37163 requested a full tablet report, sending...
I20260807 19:53:26.791224 8654 ts_manager.cc:194] Registered new tserver with Master: 0153d50ddd974025acca12343ff5b921 (127.12.155.130:42683)
I20260807 19:53:26.792150 8654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:41023
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:53:26.846011 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37163
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:38169
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:27.196297 9180 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:27.196637 9180 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:27.196802 9180 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:27.205418 9180 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:27.205554 9180 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:27.205724 9180 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:27.215385 9180 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:38169
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:37163
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:27.216691 9180 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:27.218024 9180 file_cache.cc:493] Constructed file cache file cache with capacity 419430
I20260807 19:53:27.229046 8945 heartbeater.cc:503] Master 127.12.155.190:37163 was elected leader, sending a full tablet report...
W20260807 19:53:27.232029 9189 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:27.231984 9193 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:27.232422 9187 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:27.233547 9180 server_base.cc:1034] running on GCE node
I20260807 19:53:27.234253 9180 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:27.235234 9180 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:27.236465 9180 hybrid_clock.cc:648] HybridClock initialized: now 1786132407236424 us; error 59 us; skew 500 ppm
I20260807 19:53:27.236799 9180 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:27 dist-test-slave-2p8l krb5kdc[8578](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132407, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:27.240121 9180 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:53:27.241725 9180 webserver.cc:460] Webserver started at http://127.12.155.131:38915/ using document root <none> and password file <none>
I20260807 19:53:27.242506 9180 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:27.242673 9180 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:27.243003 9180 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:27.245908 9180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61"
format_stamp: "Formatted at 2026-08-07 19:53:27 on dist-test-slave-2p8l"
server_key: "395f2a0f9a8510a62c23f5a711a0fe71"
server_key_iv: "91a2fb9e594950df260d5365cdaf71cd"
server_key_version: "encryptionkey@0"
I20260807 19:53:27.246764 9180 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61"
format_stamp: "Formatted at 2026-08-07 19:53:27 on dist-test-slave-2p8l"
server_key: "395f2a0f9a8510a62c23f5a711a0fe71"
server_key_iv: "91a2fb9e594950df260d5365cdaf71cd"
server_key_version: "encryptionkey@0"
I20260807 19:53:27.251884 9180 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:53:27.255937 9201 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:27.257344 9180 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:53:27.257558 9180 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61"
format_stamp: "Formatted at 2026-08-07 19:53:27 on dist-test-slave-2p8l"
server_key: "395f2a0f9a8510a62c23f5a711a0fe71"
server_key_iv: "91a2fb9e594950df260d5365cdaf71cd"
server_key_version: "encryptionkey@0"
I20260807 19:53:27.257803 9180 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:27.285036 9180 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:27.290262 9180 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:27.290586 9180 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:27.291662 9180 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:27.293084 9180 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:27.293195 9180 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:27.293349 9180 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:27.293424 9180 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:27.329622 9180 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:34181
I20260807 19:53:27.329669 9374 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:34181 every 8 connection(s)
I20260807 19:53:27.330938 9180 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:27.336180 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 9180
I20260807 19:53:27.336370 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:53:27.336964 12910 external_mini_cluster.cc:1428] Setting key 13750025b0af3a8c0609df8d3b8ad45b
Aug 07 19:53:27 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132407, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:27.351966 9377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.333754 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:44511 (local address 127.12.155.190:37163)
0807 19:53:27.334355 (+ 601us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.334361 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.335277 (+ 916us) server_negotiation.cc:407] Connection header received
0807 19:53:27.337852 (+ 2575us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.337857 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.337937 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.338067 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:27.339608 (+ 1541us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.340371 (+ 763us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.341897 (+ 1526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.342360 (+ 463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.342495 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.346033 (+ 3538us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:27.346039 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:27.346042 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:27.346131 (+ 89us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:27.348839 (+ 2708us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:27.349563 (+ 724us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:27.349568 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:27.349572 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:27.349701 (+ 129us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:27.350198 (+ 497us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:27.350206 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:27.350211 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:27.350481 (+ 270us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:27.350657 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.351353 (+ 696us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.351585 (+ 232us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":460,"thread_start_us":229,"threads_started":1}
I20260807 19:53:27.352905 9379 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.334323 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:37163 (local address 127.12.155.131:44511)
0807 19:53:27.335095 (+ 772us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:27.335139 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:27.337559 (+ 2420us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:27.338347 (+ 788us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:27.338355 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:27.338860 (+ 505us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:27.339417 (+ 557us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.339433 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.340525 (+ 1092us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.340536 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.341736 (+ 1200us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.341753 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.342598 (+ 845us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.342606 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.342830 (+ 224us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.343467 (+ 637us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:27.343488 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:27.345828 (+ 2340us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:27.348989 (+ 3161us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:27.348997 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:27.349013 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:27.349430 (+ 417us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:27.349818 (+ 388us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:27.349824 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:27.349827 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:27.350014 (+ 187us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:27.350625 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:27.350633 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:27.350957 (+ 324us) client_negotiation.cc:769] Sending connection context
0807 19:53:27.351218 (+ 261us) client_negotiation.cc:240] Negotiation successful
0807 19:53:27.351744 (+ 526us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":525,"thread_start_us":294,"threads_started":1}
I20260807 19:53:27.354516 9375 heartbeater.cc:347] Connected to a master server at 127.12.155.190:37163
I20260807 19:53:27.354977 9375 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:27.355753 9375 heartbeater.cc:511] Master 127.12.155.190:37163 requested a full tablet report, sending...
I20260807 19:53:27.357216 8654 ts_manager.cc:194] Registered new tserver with Master: 0990ec8dd8a14ef2a1e1aa35f6b66f61 (127.12.155.131:34181)
I20260807 19:53:27.358183 8654 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:44511
I20260807 19:53:27.365026 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:53:27.383406 9377 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.369993 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54976 (local address 127.12.155.190:37163)
0807 19:53:27.370271 (+ 278us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.370276 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.370654 (+ 378us) server_negotiation.cc:407] Connection header received
0807 19:53:27.370800 (+ 146us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.370804 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.370896 (+ 92us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.370990 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:27.372618 (+ 1628us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.373355 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.374972 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.375384 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.375486 (+ 102us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.377984 (+ 2498us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:27.377989 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:27.377992 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:27.378022 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:27.380798 (+ 2776us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:27.381483 (+ 685us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:27.381487 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:27.381489 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:27.381655 (+ 166us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:27.382036 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:27.382040 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:27.382042 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:27.382442 (+ 400us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:27.382676 (+ 234us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.383012 (+ 336us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.383181 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":120}
I20260807 19:53:27.387959 8654 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54976:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:53:27.394968 8654 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:53:27.419577 9395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.407604 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47390 (local address 127.12.155.131:34181)
0807 19:53:27.409989 (+ 2385us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.409998 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.410033 (+ 35us) server_negotiation.cc:407] Connection header received
0807 19:53:27.410182 (+ 149us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.410190 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.410445 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.411397 (+ 952us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:27.411714 (+ 317us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.413380 (+ 1666us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.416692 (+ 3312us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.417894 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.418433 (+ 539us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.418641 (+ 208us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.418902 (+ 261us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.419116 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2208,"thread_start_us":2011,"threads_started":1}
I20260807 19:53:27.419674 9396 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.407200 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:34181 (local address 127.0.0.1:47390)
0807 19:53:27.408703 (+ 1503us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:27.408743 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:27.408927 (+ 184us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:27.410700 (+ 1773us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:27.410707 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:27.410737 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:27.411189 (+ 452us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.411205 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.413563 (+ 2358us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.413572 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.416515 (+ 2943us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.416529 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.418201 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.418209 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.418527 (+ 318us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.418589 (+ 62us) client_negotiation.cc:769] Sending connection context
0807 19:53:27.418934 (+ 345us) client_negotiation.cc:240] Negotiation successful
0807 19:53:27.419200 (+ 266us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1260,"mutex_wait_us":93,"thread_start_us":2519,"threads_started":1}
I20260807 19:53:27.420151 9394 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.407868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:42683 (local address 127.0.0.1:33306)
0807 19:53:27.409968 (+ 2100us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:27.409988 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:27.410598 (+ 610us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:27.411526 (+ 928us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:27.411535 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:27.411560 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:27.412069 (+ 509us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.412082 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.413845 (+ 1763us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.413857 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.415920 (+ 2063us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.415933 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.418010 (+ 2077us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.418020 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.419451 (+ 1431us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.419488 (+ 37us) client_negotiation.cc:769] Sending connection context
0807 19:53:27.419582 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 19:53:27.419723 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1979,"mutex_wait_us":47,"thread_start_us":784,"threads_started":1}
I20260807 19:53:27.420928 9397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.408467 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33306 (local address 127.12.155.130:42683)
0807 19:53:27.409566 (+ 1099us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.409576 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.410298 (+ 722us) server_negotiation.cc:407] Connection header received
0807 19:53:27.410798 (+ 500us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.410808 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.411047 (+ 239us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.411250 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:27.412275 (+ 1025us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.413706 (+ 1431us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.416088 (+ 2382us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.417739 (+ 1651us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.417911 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.419256 (+ 1345us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.420398 (+ 1142us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.420573 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":927,"thread_start_us":780,"threads_started":1}
I20260807 19:53:27.421705 9401 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.410150 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43337 (local address 127.0.0.1:44722)
0807 19:53:27.411843 (+ 1693us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:27.411883 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:27.412084 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:27.413246 (+ 1162us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:27.413251 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:27.413279 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:27.413854 (+ 575us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.413879 (+ 25us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.416221 (+ 2342us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.416226 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.418556 (+ 2330us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.418571 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.420776 (+ 2205us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.420785 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.420962 (+ 177us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.420996 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:53:27.421094 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:53:27.421272 (+ 178us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":1488,"mutex_wait_us":75,"thread_start_us":1306,"threads_started":1}
I20260807 19:53:27.421769 9398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.410471 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44722 (local address 127.12.155.129:43337)
0807 19:53:27.412760 (+ 2289us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.412767 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.412790 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:53:27.412866 (+ 76us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.412872 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.413057 (+ 185us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.413260 (+ 203us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:27.414199 (+ 939us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.416076 (+ 1877us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.418764 (+ 2688us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.420543 (+ 1779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.420803 (+ 260us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.420967 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.421272 (+ 305us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.421436 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2124,"thread_start_us":1922,"threads_started":1}
I20260807 19:53:27.424928 9272 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb1ee694d3941c8b9a290c689977be0 (DEFAULT_TABLE table=test-table [id=477bef212fcd4e449b635c5e1f19d919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:27.424928 9062 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb1ee694d3941c8b9a290c689977be0 (DEFAULT_TABLE table=test-table [id=477bef212fcd4e449b635c5e1f19d919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:27.425354 8835 tablet_service.cc:1467] Processing CreateTablet for tablet 5eb1ee694d3941c8b9a290c689977be0 (DEFAULT_TABLE table=test-table [id=477bef212fcd4e449b635c5e1f19d919]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:27.426513 9272 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb1ee694d3941c8b9a290c689977be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:27.426508 9062 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb1ee694d3941c8b9a290c689977be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:27.426903 8835 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 5eb1ee694d3941c8b9a290c689977be0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:27.439754 9404 tablet_bootstrap.cc:492] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Bootstrap starting.
I20260807 19:53:27.441668 9405 tablet_bootstrap.cc:492] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Bootstrap starting.
I20260807 19:53:27.442620 9410 tablet_bootstrap.cc:492] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Bootstrap starting.
I20260807 19:53:27.444943 9404 tablet_bootstrap.cc:654] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:27.445703 9405 tablet_bootstrap.cc:654] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:27.446403 9410 tablet_bootstrap.cc:654] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:27.446934 9405 log.cc:824] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:27.447070 9404 log.cc:824] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:27.447742 9410 log.cc:824] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:27.450249 9404 tablet_bootstrap.cc:492] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: No bootstrap required, opened a new log
I20260807 19:53:27.450426 9405 tablet_bootstrap.cc:492] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: No bootstrap required, opened a new log
I20260807 19:53:27.450599 9404 ts_tablet_manager.cc:1397] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Time spent bootstrapping tablet: real 0.011s user 0.007s sys 0.002s
I20260807 19:53:27.450729 9405 ts_tablet_manager.cc:1397] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Time spent bootstrapping tablet: real 0.009s user 0.005s sys 0.002s
I20260807 19:53:27.450850 9410 tablet_bootstrap.cc:492] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: No bootstrap required, opened a new log
I20260807 19:53:27.451133 9410 ts_tablet_manager.cc:1397] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Time spent bootstrapping tablet: real 0.009s user 0.003s sys 0.004s
I20260807 19:53:27.459000 9404 raft_consensus.cc:348] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.459414 9404 raft_consensus.cc:374] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:27.459561 9404 raft_consensus.cc:729] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f3b5f899a3441cf9faf654e910fd697, State: Initialized, Role: FOLLOWER
I20260807 19:53:27.460258 9404 consensus_queue.cc:260] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.461771 9410 raft_consensus.cc:348] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.462265 9410 raft_consensus.cc:374] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:27.462294 9404 ts_tablet_manager.cc:1428] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Time spent starting tablet: real 0.012s user 0.004s sys 0.008s
I20260807 19:53:27.462370 9410 raft_consensus.cc:729] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0990ec8dd8a14ef2a1e1aa35f6b66f61, State: Initialized, Role: FOLLOWER
I20260807 19:53:27.462759 9405 raft_consensus.cc:348] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.463164 9405 raft_consensus.cc:374] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:27.463075 9410 consensus_queue.cc:260] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.463271 9405 raft_consensus.cc:729] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0153d50ddd974025acca12343ff5b921, State: Initialized, Role: FOLLOWER
I20260807 19:53:27.463958 9405 consensus_queue.cc:260] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.465315 9171 heartbeater.cc:503] Master 127.12.155.190:37163 was elected leader, sending a full tablet report...
I20260807 19:53:27.466303 9405 ts_tablet_manager.cc:1428] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Time spent starting tablet: real 0.015s user 0.008s sys 0.007s
I20260807 19:53:27.467649 9375 heartbeater.cc:503] Master 127.12.155.190:37163 was elected leader, sending a full tablet report...
I20260807 19:53:27.468384 9410 ts_tablet_manager.cc:1428] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Time spent starting tablet: real 0.017s user 0.015s sys 0.003s
W20260807 19:53:27.515868 9172 tablet.cc:2369] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:27.582863 9376 tablet.cc:2369] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:27.698343 8947 tablet.cc:2369] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:27.805358 9420 raft_consensus.cc:482] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:27.805750 9420 raft_consensus.cc:504] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.807677 9420 leader_election.cc:288] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0990ec8dd8a14ef2a1e1aa35f6b66f61 (127.12.155.131:34181), 0153d50ddd974025acca12343ff5b921 (127.12.155.130:42683)
I20260807 19:53:27.814932 9397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.808278 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:57455 (local address 127.12.155.130:42683)
0807 19:53:27.808478 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.808482 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.809201 (+ 719us) server_negotiation.cc:407] Connection header received
0807 19:53:27.809416 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.809420 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.809480 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.809593 (+ 113us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:27.810368 (+ 775us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.811192 (+ 824us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.813158 (+ 1966us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.813934 (+ 776us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.814161 (+ 227us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.814237 (+ 76us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.814528 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.814663 (+ 135us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:53:27.815106 9425 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.808304 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:42683 (local address 127.12.155.129:57455)
0807 19:53:27.809084 (+ 780us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:27.809105 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:27.809258 (+ 153us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:27.809608 (+ 350us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:27.809618 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:27.809739 (+ 121us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:27.810218 (+ 479us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.810228 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.811337 (+ 1109us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.811343 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.812968 (+ 1625us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.812984 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.814183 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.814190 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.814356 (+ 166us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.814380 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:53:27.814490 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 19:53:27.814623 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":619,"mutex_wait_us":66,"spinlock_wait_cycles":34688,"thread_start_us":447,"threads_started":1}
I20260807 19:53:27.815205 9395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.808178 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:38219 (local address 127.12.155.131:34181)
0807 19:53:27.808383 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.808389 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.809036 (+ 647us) server_negotiation.cc:407] Connection header received
0807 19:53:27.809298 (+ 262us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.809303 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.809372 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.809484 (+ 112us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:27.810200 (+ 716us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.811037 (+ 837us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.813177 (+ 2140us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.814173 (+ 996us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.814372 (+ 199us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.814458 (+ 86us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.814772 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.814912 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:53:27.815778 9424 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.807911 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:34181 (local address 127.12.155.129:38219)
0807 19:53:27.808860 (+ 949us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:27.808900 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:27.809107 (+ 207us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:27.809520 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:27.809525 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:27.809555 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:27.810000 (+ 445us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.810013 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.811184 (+ 1171us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.811193 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.813000 (+ 1807us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:27.813014 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.814415 (+ 1401us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.814423 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:27.814599 (+ 176us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.814624 (+ 25us) client_negotiation.cc:769] Sending connection context
0807 19:53:27.814743 (+ 119us) client_negotiation.cc:240] Negotiation successful
0807 19:53:27.814882 (+ 139us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":741,"mutex_wait_us":87,"spinlock_wait_cycles":35584,"thread_start_us":565,"threads_started":1}
I20260807 19:53:27.816529 9093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb1ee694d3941c8b9a290c689977be0" candidate_uuid: "6f3b5f899a3441cf9faf654e910fd697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0153d50ddd974025acca12343ff5b921" is_pre_election: true
I20260807 19:53:27.816859 9301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb1ee694d3941c8b9a290c689977be0" candidate_uuid: "6f3b5f899a3441cf9faf654e910fd697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" is_pre_election: true
I20260807 19:53:27.817066 9093 raft_consensus.cc:2454] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b5f899a3441cf9faf654e910fd697 in term 0.
I20260807 19:53:27.817397 9301 raft_consensus.cc:2454] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 6f3b5f899a3441cf9faf654e910fd697 in term 0.
I20260807 19:53:27.817924 8770 leader_election.cc:302] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0153d50ddd974025acca12343ff5b921, 6f3b5f899a3441cf9faf654e910fd697; no voters:
I20260807 19:53:27.818377 9420 raft_consensus.cc:2781] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:53:27.818548 9420 raft_consensus.cc:482] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:53:27.818665 9420 raft_consensus.cc:3037] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:27.821070 9420 raft_consensus.cc:504] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.821744 9420 leader_election.cc:288] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [CANDIDATE]: Term 1 election: Requested vote from peers 0990ec8dd8a14ef2a1e1aa35f6b66f61 (127.12.155.131:34181), 0153d50ddd974025acca12343ff5b921 (127.12.155.130:42683)
I20260807 19:53:27.822237 9301 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb1ee694d3941c8b9a290c689977be0" candidate_uuid: "6f3b5f899a3441cf9faf654e910fd697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61"
I20260807 19:53:27.822242 9093 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5eb1ee694d3941c8b9a290c689977be0" candidate_uuid: "6f3b5f899a3441cf9faf654e910fd697" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0153d50ddd974025acca12343ff5b921"
I20260807 19:53:27.822451 9301 raft_consensus.cc:3037] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:27.822474 9093 raft_consensus.cc:3037] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:27.824671 9093 raft_consensus.cc:2454] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b5f899a3441cf9faf654e910fd697 in term 1.
I20260807 19:53:27.824743 9301 raft_consensus.cc:2454] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 6f3b5f899a3441cf9faf654e910fd697 in term 1.
I20260807 19:53:27.825078 8770 leader_election.cc:302] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0153d50ddd974025acca12343ff5b921, 6f3b5f899a3441cf9faf654e910fd697; no voters:
I20260807 19:53:27.825384 9420 raft_consensus.cc:2781] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:27.825798 9420 raft_consensus.cc:686] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 1 LEADER]: Becoming Leader. State: Replica: 6f3b5f899a3441cf9faf654e910fd697, State: Running, Role: LEADER
I20260807 19:53:27.826392 9420 consensus_queue.cc:237] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } }
I20260807 19:53:27.831323 8650 catalog_manager.cc:5495] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 reported cstate change: term changed from 0 to 1, leader changed from <none> to 6f3b5f899a3441cf9faf654e910fd697 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "6f3b5f899a3441cf9faf654e910fd697" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "6f3b5f899a3441cf9faf654e910fd697" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43337 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 } health_report { overall_health: UNKNOWN } } }
I20260807 19:53:27.873754 9398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.868487 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44728 (local address 127.12.155.129:43337)
0807 19:53:27.868695 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.868700 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.868718 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:53:27.868865 (+ 147us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.868869 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.868955 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.869093 (+ 138us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:53:27.869505 (+ 412us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.870297 (+ 792us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.871665 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.872108 (+ 443us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.872242 (+ 134us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.872723 (+ 481us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:53:27.873261 (+ 538us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:53:27.873378 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.873474 (+ 96us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.873541 (+ 67us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:53:27.882360 9093 raft_consensus.cc:1261] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 1 FOLLOWER]: Refusing update from remote peer 6f3b5f899a3441cf9faf654e910fd697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:27.882360 9301 raft_consensus.cc:1261] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 1 FOLLOWER]: Refusing update from remote peer 6f3b5f899a3441cf9faf654e910fd697: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:27.883474 9420 consensus_queue.cc:1035] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0990ec8dd8a14ef2a1e1aa35f6b66f61" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 34181 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:27.883843 9426 consensus_queue.cc:1035] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0153d50ddd974025acca12343ff5b921" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42683 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:27.910723 8650 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:27.911041 8650 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:54976:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:27.914892 8650 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 28e3f395a49a41f79705978e88e3d509: Sending DeleteTablet for 3 replicas of tablet 5eb1ee694d3941c8b9a290c689977be0
I20260807 19:53:27.916246 9272 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb1ee694d3941c8b9a290c689977be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:27 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:47390
I20260807 19:53:27.916268 9062 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb1ee694d3941c8b9a290c689977be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:27 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:33306
I20260807 19:53:27.916358 8835 tablet_service.cc:1514] Processing DeleteTablet for tablet 5eb1ee694d3941c8b9a290c689977be0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:27 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:44722
I20260807 19:53:27.917419 9448 tablet_replica.cc:330] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: stopping tablet replica
I20260807 19:53:27.917552 9447 tablet_replica.cc:330] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: stopping tablet replica
I20260807 19:53:27.918010 9447 raft_consensus.cc:2229] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:27.918277 9448 raft_consensus.cc:2229] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:27.918466 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 8740
I20260807 19:53:27.918634 9447 raft_consensus.cc:2258] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:27.919185 9448 raft_consensus.cc:2258] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:27.922214 9448 ts_tablet_manager.cc:1905] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:27.923228 9447 ts_tablet_manager.cc:1905] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:27.928462 9449 tablet_replica.cc:330] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: stopping tablet replica
I20260807 19:53:27.929909 9448 ts_tablet_manager.cc:1918] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:27.930178 9448 log.cc:1196] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/5eb1ee694d3941c8b9a290c689977be0
I20260807 19:53:27.930467 9449 raft_consensus.cc:2229] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:53:27.930859 9448 ts_tablet_manager.cc:1939] T 5eb1ee694d3941c8b9a290c689977be0 P 0990ec8dd8a14ef2a1e1aa35f6b66f61: Deleting consensus metadata
I20260807 19:53:27.931202 9449 raft_consensus.cc:2258] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:27.932497 9447 ts_tablet_manager.cc:1918] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:27.932684 9447 log.cc:1196] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/5eb1ee694d3941c8b9a290c689977be0
I20260807 19:53:27.932929 8619 catalog_manager.cc:4841] TS 0990ec8dd8a14ef2a1e1aa35f6b66f61 (127.12.155.131:34181): tablet 5eb1ee694d3941c8b9a290c689977be0 (table test-table [id=477bef212fcd4e449b635c5e1f19d919]) successfully deleted
I20260807 19:53:27.933312 9447 ts_tablet_manager.cc:1939] T 5eb1ee694d3941c8b9a290c689977be0 P 0153d50ddd974025acca12343ff5b921: Deleting consensus metadata
I20260807 19:53:27.935252 8620 catalog_manager.cc:4841] TS 0153d50ddd974025acca12343ff5b921 (127.12.155.130:42683): tablet 5eb1ee694d3941c8b9a290c689977be0 (table test-table [id=477bef212fcd4e449b635c5e1f19d919]) successfully deleted
I20260807 19:53:27.935716 9449 ts_tablet_manager.cc:1905] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:27.941581 9449 ts_tablet_manager.cc:1918] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:27.941779 9449 log.cc:1196] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_0.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/5eb1ee694d3941c8b9a290c689977be0
Aug 07 19:53:27 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:53:27.942358 9449 ts_tablet_manager.cc:1939] T 5eb1ee694d3941c8b9a290c689977be0 P 6f3b5f899a3441cf9faf654e910fd697: Deleting consensus metadata
I20260807 19:53:27.943980 8619 catalog_manager.cc:4841] TS 6f3b5f899a3441cf9faf654e910fd697 (127.12.155.129:43337): tablet 5eb1ee694d3941c8b9a290c689977be0 (table test-table [id=477bef212fcd4e449b635c5e1f19d919]) successfully deleted
I20260807 19:53:27.950134 9398 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:27.919702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44738 (local address 127.12.155.129:43337)
0807 19:53:27.919887 (+ 185us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:27.919893 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:27.930693 (+ 10800us) server_negotiation.cc:407] Connection header received
0807 19:53:27.931226 (+ 533us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:27.931233 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:27.931336 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:27.931415 (+ 79us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:27.933618 (+ 2203us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.934894 (+ 1276us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.937044 (+ 2150us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:27.937803 (+ 759us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:27.937946 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:27.943657 (+ 5711us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:27.943673 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:27.943690 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:27.943739 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:27.947080 (+ 3341us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:27.947987 (+ 907us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:27.947994 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:27.947996 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:27.948139 (+ 143us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:27.948552 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:27.948561 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:27.948563 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:27.948939 (+ 376us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:27.949154 (+ 215us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:27.949548 (+ 394us) server_negotiation.cc:299] Negotiation successful
0807 19:53:27.949777 (+ 229us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 19:53:27.950909 8935 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:28.050179 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 8740
I20260807 19:53:28.078876 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 8954
Aug 07 19:53:28 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:53:28.097807 9397 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:28.079699 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33310 (local address 127.12.155.130:42683)
0807 19:53:28.079900 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:28.079905 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:28.079958 (+ 53us) server_negotiation.cc:407] Connection header received
0807 19:53:28.080139 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:28.080144 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:28.080210 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:28.080295 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:28.081587 (+ 1292us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:28.082358 (+ 771us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:28.083620 (+ 1262us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:28.084032 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:28.084130 (+ 98us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:28.092407 (+ 8277us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:28.092423 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:28.092440 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:28.092475 (+ 35us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:28.095220 (+ 2745us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:28.095904 (+ 684us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:28.095911 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:28.095913 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:28.096033 (+ 120us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:28.096393 (+ 360us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:28.096396 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:28.096398 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:28.096770 (+ 372us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:28.097003 (+ 233us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:28.097242 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 19:53:28.097402 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:53:28.098749 9166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:28.188525 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 8954
I20260807 19:53:28.215530 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 9180
Aug 07 19:53:28 dist-test-slave-2p8l krb5kdc[8578](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132404, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:53:28.230883 9395 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:28.216385 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47406 (local address 127.12.155.131:34181)
0807 19:53:28.216569 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:28.216574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:28.216593 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:53:28.216679 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:28.216683 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:28.216764 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:28.216852 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:28.218220 (+ 1368us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:28.218941 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:28.220224 (+ 1283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:28.220692 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:28.220788 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:28.225104 (+ 4316us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:28.225119 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:28.225137 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:28.225170 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:28.228074 (+ 2904us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:28.228799 (+ 725us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:28.228806 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:28.228809 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:28.228949 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:28.229289 (+ 340us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:28.229293 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:28.229295 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:28.229652 (+ 357us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:28.229876 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:28.230287 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 19:53:28.230446 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
I20260807 19:53:28.231540 9368 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:28.321357 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 9180
I20260807 19:53:28.348380 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 8595
I20260807 19:53:28.349713 8691 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:28.460366 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 8595
2026-08-07T19:53:28Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/0 (5121 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/1
2026-08-07T19:53:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:28Z Disabled control of system clock
I20260807 19:53:28.561265 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42821
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:42821
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 19:53:28.899950 9467 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:28.900245 9467 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:28.900331 9467 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:28.907707 9467 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:28.907815 9467 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:28.907855 9467 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:28.907915 9467 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:28.907954 9467 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:28.917057 9467 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:42821
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42821
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:28.918336 9467 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:28.920082 9467 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:28.932164 9479 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:28.932127 9476 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:28.932220 9475 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:28.933039 9467 server_base.cc:1034] running on GCE node
I20260807 19:53:28.933874 9467 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:28.935525 9467 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:28.936785 9467 hybrid_clock.cc:648] HybridClock initialized: now 1786132408936738 us; error 68 us; skew 500 ppm
I20260807 19:53:28.937219 9467 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:28.939740 9467 webserver.cc:460] Webserver started at http://127.12.155.190:46387/ using document root <none> and password file <none>
I20260807 19:53:28.940505 9467 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:28.940646 9467 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:28.940984 9467 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:28.944119 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "64abccd482534dc6a81cb4c90863e27e"
format_stamp: "Formatted at 2026-08-07 19:53:28 on dist-test-slave-2p8l"
server_key: "bd2306eccd8aeb3490dcab43cc2186f3"
server_key_iv: "e62eebe90110f8cdfc92d242c4ae059e"
server_key_version: "encryptionkey@0"
I20260807 19:53:28.944962 9467 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "64abccd482534dc6a81cb4c90863e27e"
format_stamp: "Formatted at 2026-08-07 19:53:28 on dist-test-slave-2p8l"
server_key: "bd2306eccd8aeb3490dcab43cc2186f3"
server_key_iv: "e62eebe90110f8cdfc92d242c4ae059e"
server_key_version: "encryptionkey@0"
I20260807 19:53:28.950577 9467 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.005s
I20260807 19:53:28.954273 9485 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:28.955535 9467 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:28.955742 9467 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "64abccd482534dc6a81cb4c90863e27e"
format_stamp: "Formatted at 2026-08-07 19:53:28 on dist-test-slave-2p8l"
server_key: "bd2306eccd8aeb3490dcab43cc2186f3"
server_key_iv: "e62eebe90110f8cdfc92d242c4ae059e"
server_key_version: "encryptionkey@0"
I20260807 19:53:28.955971 9467 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:28.969992 9467 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:28.970971 9467 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:28.971283 9467 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:28.991415 9467 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:42821
I20260807 19:53:28.991449 9559 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:42821 every 8 connection(s)
I20260807 19:53:28.992830 9467 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:28.996734 9562 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:28.998464 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 9467
I20260807 19:53:28.998690 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:28.999197 12910 external_mini_cluster.cc:1428] Setting key 97092cc6e7a0c11ebaf68169e60bacd9
I20260807 19:53:29.008817 9562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e: Bootstrap starting.
I20260807 19:53:29.012614 9562 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:29.013803 9562 log.cc:824] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:29.014135 9570 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:29.001318 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43382 (local address 127.12.155.190:42821)
0807 19:53:29.002533 (+ 1215us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:29.002544 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:29.002587 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:53:29.004342 (+ 1755us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:29.004364 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:29.004838 (+ 474us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:29.005209 (+ 371us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:29.005888 (+ 679us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:29.007333 (+ 1445us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:29.009352 (+ 2019us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:29.010009 (+ 657us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:29.010231 (+ 222us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:29.011603 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:29.011611 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:29.011625 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:29.012159 (+ 534us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:29.012250 (+ 91us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:29.012271 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:29.012351 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:29.012872 (+ 521us) server_negotiation.cc:299] Negotiation successful
0807 19:53:29.013121 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":770,"thread_start_us":476,"threads_started":1}
I20260807 19:53:29.016907 9562 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e: No bootstrap required, opened a new log
I20260807 19:53:29.024528 9562 raft_consensus.cc:348] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64abccd482534dc6a81cb4c90863e27e" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42821 } }
I20260807 19:53:29.024881 9562 raft_consensus.cc:374] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:29.024955 9562 raft_consensus.cc:729] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 64abccd482534dc6a81cb4c90863e27e, State: Initialized, Role: FOLLOWER
I20260807 19:53:29.025432 9562 consensus_queue.cc:260] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64abccd482534dc6a81cb4c90863e27e" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42821 } }
I20260807 19:53:29.025692 9562 raft_consensus.cc:388] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:29.025811 9562 raft_consensus.cc:482] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:29.025933 9562 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:29.028529 9562 raft_consensus.cc:504] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64abccd482534dc6a81cb4c90863e27e" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42821 } }
I20260807 19:53:29.029088 9562 leader_election.cc:302] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 64abccd482534dc6a81cb4c90863e27e; no voters:
I20260807 19:53:29.029863 9562 leader_election.cc:288] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:29.030036 9575 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:29.030815 9575 raft_consensus.cc:686] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [term 1 LEADER]: Becoming Leader. State: Replica: 64abccd482534dc6a81cb4c90863e27e, State: Running, Role: LEADER
I20260807 19:53:29.031284 9575 consensus_queue.cc:237] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64abccd482534dc6a81cb4c90863e27e" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42821 } }
I20260807 19:53:29.032073 9562 sys_catalog.cc:564] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:29.034163 9577 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "64abccd482534dc6a81cb4c90863e27e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64abccd482534dc6a81cb4c90863e27e" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42821 } } }
I20260807 19:53:29.035037 9577 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:29.034456 9578 sys_catalog.cc:455] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 64abccd482534dc6a81cb4c90863e27e. Latest consensus state: current_term: 1 leader_uuid: "64abccd482534dc6a81cb4c90863e27e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "64abccd482534dc6a81cb4c90863e27e" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42821 } } }
I20260807 19:53:29.035643 9578 sys_catalog.cc:458] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:29.038646 9582 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:29.043984 9582 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:29.065394 9582 catalog_manager.cc:1347] Generated new cluster ID: cdf751b7ea1d42f4852f79d77e2e7c5d
I20260807 19:53:29.065522 9582 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:29.088311 9582 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:29.090229 9582 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:29.100703 9582 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e: Generated new TSK 0
I20260807 19:53:29.101574 9582 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:29.105440 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42821
--builtin_ntp_servers=127.12.155.148:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 19:53:29.468484 9600 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:29.468752 9600 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:29.468837 9600 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:29.476176 9600 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:29.476269 9600 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:29.476372 9600 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:29.485196 9600 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:29.486466 9600 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:29.488287 9600 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:29.501457 9610 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:29.501577 9612 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:29.501821 9614 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:29.502686 9600 server_base.cc:1034] running on GCE node
I20260807 19:53:29.503487 9600 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:29.504552 9600 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:29.505832 9600 hybrid_clock.cc:648] HybridClock initialized: now 1786132409505763 us; error 53 us; skew 500 ppm
I20260807 19:53:29.506285 9600 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:29.508720 9600 webserver.cc:460] Webserver started at http://127.12.155.129:33163/ using document root <none> and password file <none>
I20260807 19:53:29.509459 9600 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:29.509604 9600 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:29.509948 9600 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:29.512951 9600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "8dc35588374e492b94cbd92b373d127b"
format_stamp: "Formatted at 2026-08-07 19:53:29 on dist-test-slave-2p8l"
server_key: "5eb48ea70b37c353f742cc4b4da489ba"
server_key_iv: "4c0ceab4f3dfe3406b63498cfd9aa100"
server_key_version: "encryptionkey@0"
I20260807 19:53:29.513944 9600 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "8dc35588374e492b94cbd92b373d127b"
format_stamp: "Formatted at 2026-08-07 19:53:29 on dist-test-slave-2p8l"
server_key: "5eb48ea70b37c353f742cc4b4da489ba"
server_key_iv: "4c0ceab4f3dfe3406b63498cfd9aa100"
server_key_version: "encryptionkey@0"
I20260807 19:53:29.519050 9600 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 19:53:29.522487 9621 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:29.523777 9600 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.002s
I20260807 19:53:29.523955 9600 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "8dc35588374e492b94cbd92b373d127b"
format_stamp: "Formatted at 2026-08-07 19:53:29 on dist-test-slave-2p8l"
server_key: "5eb48ea70b37c353f742cc4b4da489ba"
server_key_iv: "4c0ceab4f3dfe3406b63498cfd9aa100"
server_key_version: "encryptionkey@0"
I20260807 19:53:29.524173 9600 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:29.550145 9600 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:29.550997 9600 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:29.551317 9600 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:29.552327 9600 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:29.553803 9600 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:29.553893 9600 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:29.554050 9600 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:29.554193 9600 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.001s
I20260807 19:53:29.591435 9600 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:43127
I20260807 19:53:29.591499 9801 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:43127 every 8 connection(s)
I20260807 19:53:29.592794 9600 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:29.601712 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 9600
I20260807 19:53:29.601897 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:53:29.602523 12910 external_mini_cluster.cc:1428] Setting key 749ea48d211de979dd68e661678ea390
I20260807 19:53:29.605926 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42821
--builtin_ntp_servers=127.12.155.148:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 19:53:29.606735 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:29.595543 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:48127 (local address 127.12.155.190:42821)
0807 19:53:29.596101 (+ 558us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:29.596108 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:29.597261 (+ 1153us) server_negotiation.cc:407] Connection header received
0807 19:53:29.599089 (+ 1828us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:29.599093 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:29.599173 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:29.599272 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:29.600345 (+ 1073us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:29.601126 (+ 781us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:29.603529 (+ 2403us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:29.604133 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:29.604270 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:29.605875 (+ 1605us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:29.605880 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:29.605883 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:29.605902 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:29.605941 (+ 39us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:29.605953 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:29.606147 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:29.606368 (+ 221us) server_negotiation.cc:299] Negotiation successful
0807 19:53:29.606451 (+ 83us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":238,"threads_started":1}
I20260807 19:53:29.608209 9807 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:29.596147 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42821 (local address 127.12.155.129:48127)
0807 19:53:29.597088 (+ 941us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:29.597135 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:29.598824 (+ 1689us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:29.599480 (+ 656us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:29.599488 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:29.599616 (+ 128us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:29.600194 (+ 578us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:29.600210 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:29.601333 (+ 1123us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:29.601340 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:29.603368 (+ 2028us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:29.603385 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:29.604396 (+ 1011us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:29.604406 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:29.604655 (+ 249us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:29.605476 (+ 821us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:29.605482 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:29.605536 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:29.605662 (+ 126us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:29.606130 (+ 468us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:29.606145 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:29.606156 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:53:29.606344 (+ 188us) client_negotiation.cc:240] Negotiation successful
0807 19:53:29.606768 (+ 424us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":510,"thread_start_us":288,"threads_started":1}
I20260807 19:53:29.609738 9802 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42821
I20260807 19:53:29.610047 9802 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:29.610850 9802 heartbeater.cc:511] Master 127.12.155.190:42821 requested a full tablet report, sending...
I20260807 19:53:29.612881 9511 ts_manager.cc:194] Registered new tserver with Master: 8dc35588374e492b94cbd92b373d127b (127.12.155.129:43127)
I20260807 19:53:29.614436 9511 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.129:48127
W20260807 19:53:29.945999 9809 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:29.946344 9809 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:29.946503 9809 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:29.953728 9809 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:29.953836 9809 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:29.954015 9809 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:29.963481 9809 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:29.965250 9809 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:29.967149 9809 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:29.980551 9824 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:29.980752 9818 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:29.980772 9822 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:29.982455 9809 server_base.cc:1034] running on GCE node
I20260807 19:53:29.983393 9809 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:29.984627 9809 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:29.985878 9809 hybrid_clock.cc:648] HybridClock initialized: now 1786132409985822 us; error 44 us; skew 500 ppm
I20260807 19:53:29.986291 9809 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:29.988729 9809 webserver.cc:460] Webserver started at http://127.12.155.130:37205/ using document root <none> and password file <none>
I20260807 19:53:29.989431 9809 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:29.989590 9809 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:29.989923 9809 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:29.993758 9809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "f1c89c0fcd314736b074759084119a61"
format_stamp: "Formatted at 2026-08-07 19:53:29 on dist-test-slave-2p8l"
server_key: "3ad211e3817490fa2b6c41b49eda5e1d"
server_key_iv: "4977d28337a671f143fe90ca30584c7c"
server_key_version: "encryptionkey@0"
I20260807 19:53:29.994771 9809 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "f1c89c0fcd314736b074759084119a61"
format_stamp: "Formatted at 2026-08-07 19:53:29 on dist-test-slave-2p8l"
server_key: "3ad211e3817490fa2b6c41b49eda5e1d"
server_key_iv: "4977d28337a671f143fe90ca30584c7c"
server_key_version: "encryptionkey@0"
I20260807 19:53:30.001271 9809 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20260807 19:53:30.006192 9832 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:30.008152 9809 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.004s sys 0.000s
I20260807 19:53:30.008343 9809 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "f1c89c0fcd314736b074759084119a61"
format_stamp: "Formatted at 2026-08-07 19:53:29 on dist-test-slave-2p8l"
server_key: "3ad211e3817490fa2b6c41b49eda5e1d"
server_key_iv: "4977d28337a671f143fe90ca30584c7c"
server_key_version: "encryptionkey@0"
I20260807 19:53:30.008661 9809 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:30.048094 9809 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:30.049000 9809 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:30.049332 9809 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:30.050436 9809 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:30.051986 9809 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:30.052111 9809 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:30.052250 9809 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:30.052348 9809 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:30.089447 9809 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:45257
I20260807 19:53:30.089546 10007 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:45257 every 8 connection(s)
I20260807 19:53:30.090891 9809 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:30.097775 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 9809
I20260807 19:53:30.097983 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:53:30.098690 12910 external_mini_cluster.cc:1428] Setting key 10f83bc9ab5ebad001466b9eb4f07437
I20260807 19:53:30.102025 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42821
--builtin_ntp_servers=127.12.155.148:44113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 19:53:30.104868 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.093558 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:49535 (local address 127.12.155.190:42821)
0807 19:53:30.093750 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.093754 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.095085 (+ 1331us) server_negotiation.cc:407] Connection header received
0807 19:53:30.096936 (+ 1851us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.096941 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.097012 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.097111 (+ 99us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:30.098649 (+ 1538us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.099591 (+ 942us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.101763 (+ 2172us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.102309 (+ 546us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.102418 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.104131 (+ 1713us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:30.104136 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:30.104139 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:30.104156 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:30.104186 (+ 30us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:30.104197 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:30.104268 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.104561 (+ 293us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.104643 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:53:30.106508 10011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.093920 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42821 (local address 127.12.155.130:49535)
0807 19:53:30.094895 (+ 975us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.094945 (+ 50us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.096666 (+ 1721us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.097370 (+ 704us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.097383 (+ 13us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.097512 (+ 129us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:30.098449 (+ 937us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.098476 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.099754 (+ 1278us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.099759 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.101605 (+ 1846us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.101624 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.102556 (+ 932us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.102565 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.102928 (+ 363us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.103743 (+ 815us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:30.103747 (+ 4us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:30.103807 (+ 60us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:30.103928 (+ 121us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:30.104305 (+ 377us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:30.104321 (+ 16us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:30.104332 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.104555 (+ 223us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.104996 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":520,"thread_start_us":314,"threads_started":1}
I20260807 19:53:30.107993 10009 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42821
I20260807 19:53:30.108346 10009 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:30.109335 10009 heartbeater.cc:511] Master 127.12.155.190:42821 requested a full tablet report, sending...
I20260807 19:53:30.110985 9511 ts_manager.cc:194] Registered new tserver with Master: f1c89c0fcd314736b074759084119a61 (127.12.155.130:45257)
I20260807 19:53:30.111783 9511 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.130:49535
W20260807 19:53:30.454918 10014 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:30.455214 10014 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:30.455361 10014 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:30.462815 10014 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:30.462920 10014 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:30.463100 10014 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:30.472576 10014 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:44113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:42821
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:30.473937 10014 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:30.475731 10014 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:30.489418 10022 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:30.489337 10023 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:30.489372 10027 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:30.495402 10014 server_base.cc:1034] running on GCE node
I20260807 19:53:30.496093 10014 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:30.497148 10014 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:30.498381 10014 hybrid_clock.cc:648] HybridClock initialized: now 1786132410498326 us; error 70 us; skew 500 ppm
I20260807 19:53:30.498742 10014 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:30.501132 10014 webserver.cc:460] Webserver started at http://127.12.155.131:41907/ using document root <none> and password file <none>
I20260807 19:53:30.501842 10014 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:30.501964 10014 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:30.502369 10014 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:30.505293 10014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6"
format_stamp: "Formatted at 2026-08-07 19:53:30 on dist-test-slave-2p8l"
server_key: "e593dda6762d0cd788ed65ce713c3541"
server_key_iv: "5feebcc191213d930b866450b252c67d"
server_key_version: "encryptionkey@0"
I20260807 19:53:30.506145 10014 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6"
format_stamp: "Formatted at 2026-08-07 19:53:30 on dist-test-slave-2p8l"
server_key: "e593dda6762d0cd788ed65ce713c3541"
server_key_iv: "5feebcc191213d930b866450b252c67d"
server_key_version: "encryptionkey@0"
I20260807 19:53:30.511333 10014 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.001s
I20260807 19:53:30.514995 10033 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:30.516350 10014 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:30.516527 10014 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6"
format_stamp: "Formatted at 2026-08-07 19:53:30 on dist-test-slave-2p8l"
server_key: "e593dda6762d0cd788ed65ce713c3541"
server_key_iv: "5feebcc191213d930b866450b252c67d"
server_key_version: "encryptionkey@0"
I20260807 19:53:30.516749 10014 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:30.532567 10014 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:30.533447 10014 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:30.533776 10014 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:30.534911 10014 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:30.536504 10014 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:30.536595 10014 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:30.536763 10014 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:30.536859 10014 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:30.570268 10014 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:44585
I20260807 19:53:30.570323 10217 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:44585 every 8 connection(s)
I20260807 19:53:30.571614 10014 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:30.575704 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 10014
I20260807 19:53:30.575898 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:53:30.576498 12910 external_mini_cluster.cc:1428] Setting key cfb9f78c5c0726fda2c74fe45b161f6b
I20260807 19:53:30.584882 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.574358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:40329 (local address 127.12.155.190:42821)
0807 19:53:30.574544 (+ 186us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.574548 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.576188 (+ 1640us) server_negotiation.cc:407] Connection header received
0807 19:53:30.578440 (+ 2252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.578449 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.578544 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.578672 (+ 128us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:30.579807 (+ 1135us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.580529 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.582110 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.582516 (+ 406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.582655 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.584007 (+ 1352us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:30.584012 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:30.584015 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:30.584034 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:30.584065 (+ 31us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:30.584077 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:30.584184 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.584407 (+ 223us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.584520 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:53:30.585829 10222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.574842 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:42821 (local address 127.12.155.131:40329)
0807 19:53:30.575997 (+ 1155us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.576049 (+ 52us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.578149 (+ 2100us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.578911 (+ 762us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.578919 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.579003 (+ 84us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:30.579645 (+ 642us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.579664 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.580695 (+ 1031us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.580700 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.581931 (+ 1231us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.581943 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.582747 (+ 804us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.582754 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.582971 (+ 217us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.583686 (+ 715us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:30.583689 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:30.583726 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:30.583800 (+ 74us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:30.584183 (+ 383us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:30.584197 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:30.584207 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.584394 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.584790 (+ 396us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":572,"thread_start_us":374,"threads_started":1}
I20260807 19:53:30.587294 10218 heartbeater.cc:347] Connected to a master server at 127.12.155.190:42821
I20260807 19:53:30.587662 10218 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:30.588475 10218 heartbeater.cc:511] Master 127.12.155.190:42821 requested a full tablet report, sending...
I20260807 19:53:30.589937 9511 ts_manager.cc:194] Registered new tserver with Master: 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 (127.12.155.131:44585)
I20260807 19:53:30.591120 9511 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.131:40329
I20260807 19:53:30.592279 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:53:30.603456 9804 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.597744 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43392 (local address 127.12.155.190:42821)
0807 19:53:30.597989 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.597995 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.598508 (+ 513us) server_negotiation.cc:407] Connection header received
0807 19:53:30.598639 (+ 131us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.598643 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.598705 (+ 62us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.598790 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:30.599305 (+ 515us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.599976 (+ 671us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.601300 (+ 1324us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.601677 (+ 377us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.601768 (+ 91us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.602863 (+ 1095us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:30.602868 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:30.602871 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:30.602888 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:30.602917 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:30.602928 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:30.602998 (+ 70us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.603150 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.603221 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:53:30.607537 9510 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:43392:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:53:30.614539 9510 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:53:30.617818 9802 heartbeater.cc:503] Master 127.12.155.190:42821 was elected leader, sending a full tablet report...
I20260807 19:53:30.642375 10238 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.628013 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:45257 (local address 127.0.0.1:34532)
0807 19:53:30.632483 (+ 4470us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.632537 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.632759 (+ 222us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.634014 (+ 1255us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.634025 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.634112 (+ 87us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:30.634879 (+ 767us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.634906 (+ 27us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.636677 (+ 1771us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.636683 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.639150 (+ 2467us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.639166 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.641329 (+ 2163us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.641333 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.641581 (+ 248us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.641617 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.641755 (+ 138us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.641954 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2912,"mutex_wait_us":38,"thread_start_us":6244,"threads_started":1}
I20260807 19:53:30.642472 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.628132 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34532 (local address 127.12.155.130:45257)
0807 19:53:30.633392 (+ 5260us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.633406 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.633439 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:53:30.633526 (+ 87us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.633533 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.633789 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.633955 (+ 166us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:30.635159 (+ 1204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.636520 (+ 1361us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.639557 (+ 3037us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.640847 (+ 1290us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.640958 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.641165 (+ 207us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.641866 (+ 701us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.642039 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5096,"thread_start_us":4982,"threads_started":1}
I20260807 19:53:30.644740 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.630759 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44816 (local address 127.12.155.131:44585)
0807 19:53:30.631985 (+ 1226us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.631996 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.635215 (+ 3219us) server_negotiation.cc:407] Connection header received
0807 19:53:30.635350 (+ 135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.635358 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.635595 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.635808 (+ 213us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:30.637138 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.638766 (+ 1628us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.641946 (+ 3180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.643539 (+ 1593us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.643760 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.643976 (+ 216us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.644118 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.644291 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1020,"thread_start_us":842,"threads_started":1}
I20260807 19:53:30.645141 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.628682 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43410 (local address 127.12.155.129:43127)
0807 19:53:30.630579 (+ 1897us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.630591 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.635047 (+ 4456us) server_negotiation.cc:407] Connection header received
0807 19:53:30.635363 (+ 316us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.635371 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.635642 (+ 271us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.635816 (+ 174us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:30.637226 (+ 1410us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.638445 (+ 1219us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.641651 (+ 3206us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.643399 (+ 1748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.643595 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.643839 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.644548 (+ 709us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.644745 (+ 197us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1625,"thread_start_us":1439,"threads_started":1}
I20260807 19:53:30.645638 10244 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.630169 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:44585 (local address 127.0.0.1:44816)
0807 19:53:30.634922 (+ 4753us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.634939 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.635074 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.636131 (+ 1057us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.636137 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.636165 (+ 28us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:30.636901 (+ 736us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.636918 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.638912 (+ 1994us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.638917 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.641704 (+ 2787us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.641723 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.643749 (+ 2026us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.643757 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.643926 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.643967 (+ 41us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.644074 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.645285 (+ 1211us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4631,"mutex_wait_us":105,"thread_start_us":4230,"threads_started":1}
I20260807 19:53:30.646040 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.628099 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43410)
0807 19:53:30.634894 (+ 6795us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.634919 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.635153 (+ 234us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.636153 (+ 1000us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.636157 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.636175 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:30.636924 (+ 749us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.636934 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.638606 (+ 1672us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.638615 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.641333 (+ 2718us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.641350 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.644092 (+ 2742us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.644099 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.644283 (+ 184us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.644317 (+ 34us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.645562 (+ 1245us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.645681 (+ 119us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":6629,"mutex_wait_us":60,"thread_start_us":2682,"threads_started":1}
I20260807 19:53:30.647075 9897 tablet_service.cc:1467] Processing CreateTablet for tablet 099594843b1548e3937a66445f71fefc (DEFAULT_TABLE table=test-table [id=d8d2881d69ba44b6a1cf992230d12b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:30.648422 9897 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099594843b1548e3937a66445f71fefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:30.650224 10109 tablet_service.cc:1467] Processing CreateTablet for tablet 099594843b1548e3937a66445f71fefc (DEFAULT_TABLE table=test-table [id=d8d2881d69ba44b6a1cf992230d12b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:30.650224 9695 tablet_service.cc:1467] Processing CreateTablet for tablet 099594843b1548e3937a66445f71fefc (DEFAULT_TABLE table=test-table [id=d8d2881d69ba44b6a1cf992230d12b3b]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:30.651813 9695 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099594843b1548e3937a66445f71fefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:30.651831 10109 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 099594843b1548e3937a66445f71fefc. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:30.661324 10248 tablet_bootstrap.cc:492] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Bootstrap starting.
I20260807 19:53:30.664829 10248 tablet_bootstrap.cc:654] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:30.665970 10248 log.cc:824] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:30.670315 10250 tablet_bootstrap.cc:492] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: Bootstrap starting.
I20260807 19:53:30.670423 10248 tablet_bootstrap.cc:492] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: No bootstrap required, opened a new log
I20260807 19:53:30.670718 10248 ts_tablet_manager.cc:1397] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Time spent bootstrapping tablet: real 0.010s user 0.005s sys 0.004s
I20260807 19:53:30.670879 10254 tablet_bootstrap.cc:492] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Bootstrap starting.
I20260807 19:53:30.673983 10254 tablet_bootstrap.cc:654] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:30.674383 10250 tablet_bootstrap.cc:654] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:30.675307 10254 log.cc:824] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:30.675683 10250 log.cc:824] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:30.678934 10254 tablet_bootstrap.cc:492] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: No bootstrap required, opened a new log
I20260807 19:53:30.678951 10250 tablet_bootstrap.cc:492] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: No bootstrap required, opened a new log
I20260807 19:53:30.679214 10254 ts_tablet_manager.cc:1397] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 19:53:30.679240 10250 ts_tablet_manager.cc:1397] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.001s
I20260807 19:53:30.682256 10248 raft_consensus.cc:348] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.682845 10248 raft_consensus.cc:374] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:30.683003 10248 raft_consensus.cc:729] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f1c89c0fcd314736b074759084119a61, State: Initialized, Role: FOLLOWER
I20260807 19:53:30.683872 10248 consensus_queue.cc:260] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.685158 10009 heartbeater.cc:503] Master 127.12.155.190:42821 was elected leader, sending a full tablet report...
I20260807 19:53:30.685875 10248 ts_tablet_manager.cc:1428] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Time spent starting tablet: real 0.015s user 0.014s sys 0.000s
I20260807 19:53:30.688599 10250 raft_consensus.cc:348] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.689134 10250 raft_consensus.cc:374] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:30.689252 10250 raft_consensus.cc:729] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 8dc35588374e492b94cbd92b373d127b, State: Initialized, Role: FOLLOWER
I20260807 19:53:30.689940 10250 consensus_queue.cc:260] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.692862 10250 ts_tablet_manager.cc:1428] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: Time spent starting tablet: real 0.013s user 0.010s sys 0.003s
I20260807 19:53:30.692538 10254 raft_consensus.cc:348] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.693053 10254 raft_consensus.cc:374] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:30.693192 10254 raft_consensus.cc:729] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 04440ee5b4fd4cb0a4a4f7f5d05e3ec6, State: Initialized, Role: FOLLOWER
I20260807 19:53:30.693876 10254 consensus_queue.cc:260] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.695310 10218 heartbeater.cc:503] Master 127.12.155.190:42821 was elected leader, sending a full tablet report...
I20260807 19:53:30.696096 10254 ts_tablet_manager.cc:1428] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Time spent starting tablet: real 0.017s user 0.012s sys 0.004s
I20260807 19:53:30.737445 10263 raft_consensus.cc:482] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:30.737829 10263 raft_consensus.cc:504] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.739734 10263 leader_election.cc:288] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f1c89c0fcd314736b074759084119a61 (127.12.155.130:45257), 8dc35588374e492b94cbd92b373d127b (127.12.155.129:43127)
I20260807 19:53:30.747112 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.740326 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:47253 (local address 127.12.155.129:43127)
0807 19:53:30.740569 (+ 243us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.740574 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.740755 (+ 181us) server_negotiation.cc:407] Connection header received
0807 19:53:30.741012 (+ 257us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.741021 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.741158 (+ 137us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.741278 (+ 120us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:30.741853 (+ 575us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.742980 (+ 1127us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.744940 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.746213 (+ 1273us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.746352 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.746409 (+ 57us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.746763 (+ 354us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.746870 (+ 107us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 19:53:30.747237 10222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.740247 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.12.155.131:47253)
0807 19:53:30.740605 (+ 358us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.740645 (+ 40us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.740823 (+ 178us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.741350 (+ 527us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.741357 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.741387 (+ 30us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:30.741665 (+ 278us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.741678 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.743157 (+ 1479us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.743162 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.744762 (+ 1600us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.744775 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.746377 (+ 1602us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.746383 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.746561 (+ 178us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.746596 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.746706 (+ 110us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.746858 (+ 152us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":229,"spinlock_wait_cycles":18816}
I20260807 19:53:30.748003 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.740202 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:52195 (local address 127.12.155.130:45257)
0807 19:53:30.740418 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.740426 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.741376 (+ 950us) server_negotiation.cc:407] Connection header received
0807 19:53:30.741591 (+ 215us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.741598 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.741689 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.741790 (+ 101us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:30.742625 (+ 835us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.743538 (+ 913us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.745875 (+ 2337us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.747023 (+ 1148us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.747174 (+ 151us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.747245 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.747677 (+ 432us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.747789 (+ 112us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:53:30.748086 10264 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.740433 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:45257 (local address 127.12.155.131:52195)
0807 19:53:30.741278 (+ 845us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.741297 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:30.741435 (+ 138us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:30.741848 (+ 413us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:30.741853 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:30.741880 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:30.742354 (+ 474us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.742368 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.743717 (+ 1349us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.743721 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.745625 (+ 1904us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:30.745642 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.747235 (+ 1593us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.747245 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:30.747425 (+ 180us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.747483 (+ 58us) client_negotiation.cc:769] Sending connection context
0807 19:53:30.747609 (+ 126us) client_negotiation.cc:240] Negotiation successful
0807 19:53:30.747758 (+ 149us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":689,"thread_start_us":474,"threads_started":1}
I20260807 19:53:30.748536 9728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099594843b1548e3937a66445f71fefc" candidate_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc35588374e492b94cbd92b373d127b" is_pre_election: true
I20260807 19:53:30.749094 9728 raft_consensus.cc:2454] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 in term 0.
I20260807 19:53:30.749039 9934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099594843b1548e3937a66445f71fefc" candidate_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c89c0fcd314736b074759084119a61" is_pre_election: true
I20260807 19:53:30.749498 9934 raft_consensus.cc:2454] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 in term 0.
I20260807 19:53:30.749867 10036 leader_election.cc:302] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04440ee5b4fd4cb0a4a4f7f5d05e3ec6, 8dc35588374e492b94cbd92b373d127b; no voters:
I20260807 19:53:30.750340 10263 raft_consensus.cc:2781] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:53:30.750531 10263 raft_consensus.cc:482] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:53:30.750648 10263 raft_consensus.cc:3037] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:30.753073 10263 raft_consensus.cc:504] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.753697 10263 leader_election.cc:288] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [CANDIDATE]: Term 1 election: Requested vote from peers f1c89c0fcd314736b074759084119a61 (127.12.155.130:45257), 8dc35588374e492b94cbd92b373d127b (127.12.155.129:43127)
I20260807 19:53:30.754215 9728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099594843b1548e3937a66445f71fefc" candidate_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "8dc35588374e492b94cbd92b373d127b"
I20260807 19:53:30.754213 9934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "099594843b1548e3937a66445f71fefc" candidate_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f1c89c0fcd314736b074759084119a61"
I20260807 19:53:30.754407 9728 raft_consensus.cc:3037] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:30.754436 9934 raft_consensus.cc:3037] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:30.756582 9728 raft_consensus.cc:2454] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 in term 1.
I20260807 19:53:30.757009 10036 leader_election.cc:302] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 04440ee5b4fd4cb0a4a4f7f5d05e3ec6, 8dc35588374e492b94cbd92b373d127b; no voters:
I20260807 19:53:30.757078 9934 raft_consensus.cc:2454] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 in term 1.
I20260807 19:53:30.757304 10263 raft_consensus.cc:2781] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:30.757859 10263 raft_consensus.cc:686] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 1 LEADER]: Becoming Leader. State: Replica: 04440ee5b4fd4cb0a4a4f7f5d05e3ec6, State: Running, Role: LEADER
I20260807 19:53:30.758399 10263 consensus_queue.cc:237] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } }
I20260807 19:53:30.763269 9510 catalog_manager.cc:5495] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 (127.12.155.131). New cstate: current_term: 1 leader_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "04440ee5b4fd4cb0a4a4f7f5d05e3ec6" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44585 } health_report { overall_health: HEALTHY } } }
I20260807 19:53:30.795073 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.789307 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44830 (local address 127.12.155.131:44585)
0807 19:53:30.789496 (+ 189us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.789501 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.789521 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:53:30.789628 (+ 107us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.789633 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.789719 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.789872 (+ 153us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:53:30.790355 (+ 483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.791198 (+ 843us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.792839 (+ 1641us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.793290 (+ 451us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.793395 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.793891 (+ 496us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:53:30.794528 (+ 637us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:53:30.794666 (+ 138us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.794781 (+ 115us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.794859 (+ 78us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:53:30.803814 9934 raft_consensus.cc:1261] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 1 FOLLOWER]: Refusing update from remote peer 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:30.803805 9728 raft_consensus.cc:1261] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 1 FOLLOWER]: Refusing update from remote peer 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:30.804939 10265 consensus_queue.cc:1035] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f1c89c0fcd314736b074759084119a61" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:30.805320 10263 consensus_queue.cc:1035] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "8dc35588374e492b94cbd92b373d127b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 43127 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:30.818432 10269 mvcc.cc:205] Tried to move back new op lower bound from 7315998354641272832 to 7315998354470674432. Current Snapshot: MvccSnapshot[applied={T|T < 7315998354641272832}]
I20260807 19:53:30.835235 9511 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:43392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:30.835494 9511 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:43392:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:30.839475 9511 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 64abccd482534dc6a81cb4c90863e27e: Sending DeleteTablet for 3 replicas of tablet 099594843b1548e3937a66445f71fefc
I20260807 19:53:30.840857 9897 tablet_service.cc:1514] Processing DeleteTablet for tablet 099594843b1548e3937a66445f71fefc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:30 UTC) from {username='slave'} at 127.0.0.1:34532
I20260807 19:53:30.841064 10109 tablet_service.cc:1514] Processing DeleteTablet for tablet 099594843b1548e3937a66445f71fefc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:30 UTC) from {username='slave'} at 127.0.0.1:44816
I20260807 19:53:30.841178 9695 tablet_service.cc:1514] Processing DeleteTablet for tablet 099594843b1548e3937a66445f71fefc with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:30 UTC) from {username='slave'} at 127.0.0.1:43410
I20260807 19:53:30.842430 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 9600
I20260807 19:53:30.851243 10289 tablet_replica.cc:330] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: stopping tablet replica
I20260807 19:53:30.851624 10286 tablet_replica.cc:330] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: stopping tablet replica
I20260807 19:53:30.851770 10289 raft_consensus.cc:2229] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:30.852016 10286 raft_consensus.cc:2229] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:30.852339 10289 raft_consensus.cc:2258] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:30.852489 10286 raft_consensus.cc:2258] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:30.853116 10288 tablet_replica.cc:330] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: stopping tablet replica
I20260807 19:53:30.853605 10288 raft_consensus.cc:2229] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:53:30.854290 10288 raft_consensus.cc:2258] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:30.856428 10288 ts_tablet_manager.cc:1905] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:30.856606 10289 ts_tablet_manager.cc:1905] T 099594843b1548e3937a66445f71fefc P 8dc35588374e492b94cbd92b373d127b: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:30.861595 10242 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.843917 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43418 (local address 127.12.155.129:43127)
0807 19:53:30.844165 (+ 248us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.844176 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.850824 (+ 6648us) server_negotiation.cc:407] Connection header received
0807 19:53:30.853215 (+ 2391us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.853222 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.853325 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.853407 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:30.854110 (+ 703us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.855268 (+ 1158us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.857333 (+ 2065us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.858090 (+ 757us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.858201 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.859817 (+ 1616us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:30.859829 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:30.859846 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:30.860614 (+ 768us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:30.860679 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:30.860705 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:30.860797 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.861083 (+ 286us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.861198 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:53:30.862717 9797 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:30.863199 10286 ts_tablet_manager.cc:1905] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:30.865926 10288 ts_tablet_manager.cc:1918] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:30.866175 10288 log.cc:1196] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/099594843b1548e3937a66445f71fefc
I20260807 19:53:30.866734 10288 ts_tablet_manager.cc:1939] T 099594843b1548e3937a66445f71fefc P 04440ee5b4fd4cb0a4a4f7f5d05e3ec6: Deleting consensus metadata
I20260807 19:53:30.868240 9486 catalog_manager.cc:4841] TS 04440ee5b4fd4cb0a4a4f7f5d05e3ec6 (127.12.155.131:44585): tablet 099594843b1548e3937a66445f71fefc (table test-table [id=d8d2881d69ba44b6a1cf992230d12b3b]) successfully deleted
I20260807 19:53:30.871361 10286 ts_tablet_manager.cc:1918] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:30.871541 10286 log.cc:1196] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_1.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/099594843b1548e3937a66445f71fefc
I20260807 19:53:30.872115 10286 ts_tablet_manager.cc:1939] T 099594843b1548e3937a66445f71fefc P f1c89c0fcd314736b074759084119a61: Deleting consensus metadata
I20260807 19:53:30.874384 9487 catalog_manager.cc:4841] TS f1c89c0fcd314736b074759084119a61 (127.12.155.130:45257): tablet 099594843b1548e3937a66445f71fefc (table test-table [id=d8d2881d69ba44b6a1cf992230d12b3b]) successfully deleted
I20260807 19:53:30.954888 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 9600
W20260807 19:53:30.987498 9488 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:43127 (error 108)
I20260807 19:53:30.988381 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 9809
I20260807 19:53:30.990008 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.989412 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43428)
0807 19:53:30.989681 (+ 269us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:30.989821 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260807 19:53:30.990427 9488 catalog_manager.cc:4584] TS 8dc35588374e492b94cbd92b373d127b (127.12.155.129:43127): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 099594843b1548e3937a66445f71fefc: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
I20260807 19:53:30.996416 10240 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:30.989358 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34536 (local address 127.12.155.130:45257)
0807 19:53:30.989575 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:30.989582 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:30.989630 (+ 48us) server_negotiation.cc:407] Connection header received
0807 19:53:30.989854 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:30.989860 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:30.989984 (+ 124us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:30.990131 (+ 147us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:30.990620 (+ 489us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.991775 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.993166 (+ 1391us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:30.993607 (+ 441us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:30.993749 (+ 142us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:30.994978 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:30.994987 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:30.995002 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:30.995614 (+ 612us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:30.995666 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:30.995686 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:30.995812 (+ 126us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:30.995954 (+ 142us) server_negotiation.cc:299] Negotiation successful
0807 19:53:30.996067 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 19:53:30.997190 10000 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:31.044214 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.043631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43440)
0807 19:53:31.043885 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.044002 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 19:53:31.045433 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.045019 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43442)
0807 19:53:31.045186 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.045275 (+ 89us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 19:53:31.101486 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 9809
I20260807 19:53:31.108135 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.107666 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43446)
0807 19:53:31.107867 (+ 201us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.107959 (+ 92us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":73}
I20260807 19:53:31.109120 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.108764 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43450)
0807 19:53:31.108931 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.109004 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
I20260807 19:53:31.131136 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 10014
I20260807 19:53:31.139739 10246 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.132235 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:44836 (local address 127.12.155.131:44585)
0807 19:53:31.132416 (+ 181us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:31.132420 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:31.132439 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:53:31.132497 (+ 58us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:31.132504 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:31.132584 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:31.132668 (+ 84us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:31.133270 (+ 602us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:31.134227 (+ 957us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:31.136109 (+ 1882us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:31.136652 (+ 543us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:31.136753 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:31.138136 (+ 1383us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:31.138147 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:31.138162 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:31.138904 (+ 742us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:31.138955 (+ 51us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:31.138975 (+ 20us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:31.139056 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:31.139244 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 19:53:31.139330 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 19:53:31.140460 10210 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:31.189924 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.189399 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43464)
0807 19:53:31.189647 (+ 248us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.189751 (+ 104us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 19:53:31.191020 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.190631 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43472)
0807 19:53:31.190836 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.190907 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260807 19:53:31.262715 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 10014
I20260807 19:53:31.291659 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 9467
I20260807 19:53:31.292796 9553 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:31.405380 10239 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:31.404899 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:43127 (local address 127.0.0.1:43486)
0807 19:53:31.405105 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:31.405192 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:43127: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
I20260807 19:53:31.405815 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 9467
2026-08-07T19:53:31Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/1 (2945 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/2
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:31 dist-test-slave-2p8l krb5kdc[10307](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:31 dist-test-slave-2p8l krb5kdc[10307](info): set up 2 sockets
Aug 07 19:53:31 dist-test-slave-2p8l krb5kdc[10307](info): commencing operation
krb5kdc: starting...
W20260807 19:53:32.815371 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.356s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:33 dist-test-slave-2p8l krb5kdc[10307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:33Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:33Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:53:33.125443 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:32995
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:32995
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:33.463415 10326 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:33.463688 10326 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:33.463856 10326 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:33.471115 10326 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:33.471225 10326 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:33.471331 10326 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:33.471424 10326 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:33.471500 10326 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:33.481315 10326 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:32995
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:32995
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:33.482712 10326 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:33.484031 10326 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:33.495818 10334 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:33.495893 10337 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:33.495929 10335 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:33.497148 10326 server_base.cc:1034] running on GCE node
I20260807 19:53:33.497846 10326 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:33.499277 10326 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:33.500492 10326 hybrid_clock.cc:648] HybridClock initialized: now 1786132413500443 us; error 34 us; skew 500 ppm
I20260807 19:53:33.500857 10326 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:33 dist-test-slave-2p8l krb5kdc[10307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132413, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:33.509097 10326 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:53:33.510902 10326 webserver.cc:460] Webserver started at http://127.12.155.190:33215/ using document root <none> and password file <none>
I20260807 19:53:33.511632 10326 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:33.511785 10326 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:33.512125 10326 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:33.515281 10326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "255494914ac54d089b2d50d9c8702c23"
format_stamp: "Formatted at 2026-08-07 19:53:33 on dist-test-slave-2p8l"
server_key: "a9401d7464a82d21d74ab5778187f72b"
server_key_iv: "002758fcb03d03149355840ca1cd2463"
server_key_version: "encryptionkey@0"
I20260807 19:53:33.516041 10326 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "255494914ac54d089b2d50d9c8702c23"
format_stamp: "Formatted at 2026-08-07 19:53:33 on dist-test-slave-2p8l"
server_key: "a9401d7464a82d21d74ab5778187f72b"
server_key_iv: "002758fcb03d03149355840ca1cd2463"
server_key_version: "encryptionkey@0"
I20260807 19:53:33.521252 10326 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:53:33.524771 10351 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:33.526139 10326 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:33.526304 10326 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "255494914ac54d089b2d50d9c8702c23"
format_stamp: "Formatted at 2026-08-07 19:53:33 on dist-test-slave-2p8l"
server_key: "a9401d7464a82d21d74ab5778187f72b"
server_key_iv: "002758fcb03d03149355840ca1cd2463"
server_key_version: "encryptionkey@0"
I20260807 19:53:33.526516 10326 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:33.546231 10326 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:33.550494 10326 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:33.550805 10326 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:33.570655 10326 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:32995
I20260807 19:53:33.570690 10422 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:32995 every 8 connection(s)
I20260807 19:53:33.572144 10326 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:33.573920 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 10326
I20260807 19:53:33.574151 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:33.574761 12910 external_mini_cluster.cc:1428] Setting key 836a375e4e82070bfd609f5dabaddd01
I20260807 19:53:33.576922 10424 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:53:33 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:33.590878 10424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23: Bootstrap starting.
I20260807 19:53:33.594229 10424 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:33.595336 10424 log.cc:824] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:33.599236 10424 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23: No bootstrap required, opened a new log
I20260807 19:53:33.599653 10427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:33.576736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59502 (local address 127.12.155.190:32995)
0807 19:53:33.577508 (+ 772us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:33.577519 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:33.577561 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:53:33.579289 (+ 1728us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:33.579312 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:33.579692 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:33.580014 (+ 322us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:33.581929 (+ 1915us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:33.583381 (+ 1452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:33.585280 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:33.585949 (+ 669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:33.586163 (+ 214us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:33.591325 (+ 5162us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:33.591334 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:33.591348 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:33.591394 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:33.594867 (+ 3473us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:33.595738 (+ 871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:33.595751 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:33.595758 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:33.596050 (+ 292us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:33.596518 (+ 468us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:33.596526 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:33.596530 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:33.597138 (+ 608us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:33.597375 (+ 237us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:33.597922 (+ 547us) server_negotiation.cc:299] Negotiation successful
0807 19:53:33.598410 (+ 488us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":577,"thread_start_us":358,"threads_started":1}
I20260807 19:53:33.607431 10424 raft_consensus.cc:348] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255494914ac54d089b2d50d9c8702c23" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 32995 } }
I20260807 19:53:33.607823 10424 raft_consensus.cc:374] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:33.607934 10424 raft_consensus.cc:729] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 255494914ac54d089b2d50d9c8702c23, State: Initialized, Role: FOLLOWER
I20260807 19:53:33.608469 10424 consensus_queue.cc:260] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255494914ac54d089b2d50d9c8702c23" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 32995 } }
I20260807 19:53:33.608708 10424 raft_consensus.cc:388] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:33.608852 10424 raft_consensus.cc:482] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:33.609025 10424 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:33.611290 10424 raft_consensus.cc:504] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255494914ac54d089b2d50d9c8702c23" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 32995 } }
I20260807 19:53:33.611791 10424 leader_election.cc:302] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 255494914ac54d089b2d50d9c8702c23; no voters:
I20260807 19:53:33.612392 10424 leader_election.cc:288] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:33.612540 10431 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:33.613324 10431 raft_consensus.cc:686] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [term 1 LEADER]: Becoming Leader. State: Replica: 255494914ac54d089b2d50d9c8702c23, State: Running, Role: LEADER
I20260807 19:53:33.613879 10431 consensus_queue.cc:237] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255494914ac54d089b2d50d9c8702c23" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 32995 } }
I20260807 19:53:33.614629 10424 sys_catalog.cc:564] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:33.616617 10435 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "255494914ac54d089b2d50d9c8702c23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255494914ac54d089b2d50d9c8702c23" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 32995 } } }
I20260807 19:53:33.616955 10435 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:33.618626 10436 sys_catalog.cc:455] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 255494914ac54d089b2d50d9c8702c23. Latest consensus state: current_term: 1 leader_uuid: "255494914ac54d089b2d50d9c8702c23" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "255494914ac54d089b2d50d9c8702c23" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 32995 } } }
I20260807 19:53:33.618935 10436 sys_catalog.cc:458] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:33.619827 10448 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:33.625017 10448 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:33.634227 10448 catalog_manager.cc:1347] Generated new cluster ID: adb21b1d347544c885f41e5ea985aead
I20260807 19:53:33.634348 10448 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:33.651208 10448 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:33.652631 10448 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:33.662518 10448 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23: Generated new TSK 0
I20260807 19:53:33.663391 10448 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:53:33.751127 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:32995
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:34.099483 10476 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:34.099836 10476 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:34.100019 10476 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:34.107856 10476 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:34.107956 10476 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:34.108155 10476 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:34.117892 10476 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:32995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:34.119171 10476 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:34.120539 10476 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:34.133605 10483 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:34.133775 10482 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:34.133796 10485 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:34.134855 10476 server_base.cc:1034] running on GCE node
I20260807 19:53:34.135540 10476 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:34.136574 10476 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:34.137826 10476 hybrid_clock.cc:648] HybridClock initialized: now 1786132414137765 us; error 55 us; skew 500 ppm
I20260807 19:53:34.138231 10476 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:34 dist-test-slave-2p8l krb5kdc[10307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:34.141616 10476 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:53:34.143174 10476 webserver.cc:460] Webserver started at http://127.12.155.129:39913/ using document root <none> and password file <none>
I20260807 19:53:34.143968 10476 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:34.144140 10476 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:34.144481 10476 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:34.147601 10476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "49b755a2ab124c168ebe234cb58c1b4b"
format_stamp: "Formatted at 2026-08-07 19:53:34 on dist-test-slave-2p8l"
server_key: "f59288104df6e0674ab50ada4c8d2056"
server_key_iv: "c63d5f550a91cb59c37c0ded12f7493a"
server_key_version: "encryptionkey@0"
I20260807 19:53:34.148447 10476 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "49b755a2ab124c168ebe234cb58c1b4b"
format_stamp: "Formatted at 2026-08-07 19:53:34 on dist-test-slave-2p8l"
server_key: "f59288104df6e0674ab50ada4c8d2056"
server_key_iv: "c63d5f550a91cb59c37c0ded12f7493a"
server_key_version: "encryptionkey@0"
I20260807 19:53:34.153836 10476 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:53:34.157338 10499 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:34.158874 10476 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:34.159055 10476 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "49b755a2ab124c168ebe234cb58c1b4b"
format_stamp: "Formatted at 2026-08-07 19:53:34 on dist-test-slave-2p8l"
server_key: "f59288104df6e0674ab50ada4c8d2056"
server_key_iv: "c63d5f550a91cb59c37c0ded12f7493a"
server_key_version: "encryptionkey@0"
I20260807 19:53:34.159269 10476 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:34.181953 10476 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:34.186472 10476 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:34.186777 10476 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:34.187801 10476 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:34.189119 10476 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:34.189227 10476 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:34.189376 10476 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:34.189450 10476 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:34.224668 10476 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:37257
I20260807 19:53:34.224767 10686 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:37257 every 8 connection(s)
I20260807 19:53:34.226007 10476 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:34.231447 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 10476
I20260807 19:53:34.231647 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:53:34.232254 12910 external_mini_cluster.cc:1428] Setting key dfb8a23a67dcca4d609f20f066a70a7c
Aug 07 19:53:34 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:34.249459 10690 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:34.228523 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:37783 (local address 127.12.155.190:32995)
0807 19:53:34.228947 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:34.228952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:34.230045 (+ 1093us) server_negotiation.cc:407] Connection header received
0807 19:53:34.232568 (+ 2523us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:34.232573 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:34.232648 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:34.232751 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:34.234557 (+ 1806us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.235342 (+ 785us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.237882 (+ 2540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.238363 (+ 481us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.238472 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:34.242914 (+ 4442us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:34.242920 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:34.242924 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:34.242976 (+ 52us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:34.246097 (+ 3121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:34.246915 (+ 818us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:34.246921 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:34.246930 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:34.247065 (+ 135us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:34.247560 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:34.247564 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:34.247566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:34.247851 (+ 285us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:34.248032 (+ 181us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:34.248805 (+ 773us) server_negotiation.cc:299] Negotiation successful
0807 19:53:34.249064 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":314,"thread_start_us":208,"threads_started":1}
I20260807 19:53:34.250607 10693 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:34.229088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:32995 (local address 127.12.155.129:37783)
0807 19:53:34.229879 (+ 791us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:34.229924 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:34.232220 (+ 2296us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:34.232992 (+ 772us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:34.232999 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:34.233632 (+ 633us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:34.234352 (+ 720us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:34.234370 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.235506 (+ 1136us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.235515 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:34.237711 (+ 2196us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:34.237729 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.238605 (+ 876us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.238615 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:34.238943 (+ 328us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:34.239700 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:34.239734 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:34.242662 (+ 2928us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:34.246262 (+ 3600us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:34.246272 (+ 10us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:34.246289 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:34.246773 (+ 484us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:34.247188 (+ 415us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:34.247193 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:34.247197 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:34.247411 (+ 214us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:34.247997 (+ 586us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:34.248006 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:34.248376 (+ 370us) client_negotiation.cc:769] Sending connection context
0807 19:53:34.248673 (+ 297us) client_negotiation.cc:240] Negotiation successful
0807 19:53:34.249234 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":565,"thread_start_us":272,"threads_started":1}
I20260807 19:53:34.252305 10688 heartbeater.cc:347] Connected to a master server at 127.12.155.190:32995
I20260807 19:53:34.252651 10688 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:34.253522 10688 heartbeater.cc:511] Master 127.12.155.190:32995 requested a full tablet report, sending...
I20260807 19:53:34.256129 10375 ts_manager.cc:194] Registered new tserver with Master: 49b755a2ab124c168ebe234cb58c1b4b (127.12.155.129:37257)
I20260807 19:53:34.258311 10375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:37783
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:53:34.301580 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:32995
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:34.638553 10699 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:34.638834 10699 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:34.638988 10699 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:34.646341 10699 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:34.646451 10699 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:34.646656 10699 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:34.656490 10699 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:32995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:34.657873 10699 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:34.659317 10699 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:34.672926 10706 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:34.672887 10710 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:34.672958 10707 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:34.673703 10699 server_base.cc:1034] running on GCE node
I20260807 19:53:34.674319 10699 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:34.675197 10699 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:34.676443 10699 hybrid_clock.cc:648] HybridClock initialized: now 1786132414676395 us; error 44 us; skew 500 ppm
I20260807 19:53:34.676759 10699 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:34 dist-test-slave-2p8l krb5kdc[10307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:34.679877 10699 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:53:34.681272 10699 webserver.cc:460] Webserver started at http://127.12.155.130:45037/ using document root <none> and password file <none>
I20260807 19:53:34.681946 10699 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:34.682123 10699 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:34.682451 10699 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:34.685302 10699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "026437adc00844cfa3329451b6ea6368"
format_stamp: "Formatted at 2026-08-07 19:53:34 on dist-test-slave-2p8l"
server_key: "2e9f6fb8501d872679687f6c0c791da3"
server_key_iv: "da101e64539273b683bfdbb7006e2d41"
server_key_version: "encryptionkey@0"
I20260807 19:53:34.686096 10699 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "026437adc00844cfa3329451b6ea6368"
format_stamp: "Formatted at 2026-08-07 19:53:34 on dist-test-slave-2p8l"
server_key: "2e9f6fb8501d872679687f6c0c791da3"
server_key_iv: "da101e64539273b683bfdbb7006e2d41"
server_key_version: "encryptionkey@0"
I20260807 19:53:34.691170 10699 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.001s
I20260807 19:53:34.694856 10721 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:34.696171 10699 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:34.696345 10699 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "026437adc00844cfa3329451b6ea6368"
format_stamp: "Formatted at 2026-08-07 19:53:34 on dist-test-slave-2p8l"
server_key: "2e9f6fb8501d872679687f6c0c791da3"
server_key_iv: "da101e64539273b683bfdbb7006e2d41"
server_key_version: "encryptionkey@0"
I20260807 19:53:34.696554 10699 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:34.712461 10699 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:34.716874 10699 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:34.717170 10699 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:34.718216 10699 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:34.719597 10699 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:34.719699 10699 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:34.719843 10699 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:34.719936 10699 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:34.754608 10699 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:38705
I20260807 19:53:34.754695 10887 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:38705 every 8 connection(s)
I20260807 19:53:34.755919 10699 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:34.760311 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 10699
I20260807 19:53:34.760553 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:53:34.761170 12910 external_mini_cluster.cc:1428] Setting key 04b545927a37ad0c5342554626533789
Aug 07 19:53:34 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132414, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:34.777791 10891 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:34.758577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:46621 (local address 127.12.155.190:32995)
0807 19:53:34.759169 (+ 592us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:34.759175 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:34.760313 (+ 1138us) server_negotiation.cc:407] Connection header received
0807 19:53:34.762919 (+ 2606us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:34.762925 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:34.763025 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:34.763155 (+ 130us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:34.764886 (+ 1731us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.765725 (+ 839us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.767505 (+ 1780us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.767975 (+ 470us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.768121 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:34.771848 (+ 3727us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:34.771854 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:34.771858 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:34.771894 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:34.774687 (+ 2793us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:34.775432 (+ 745us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:34.775437 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:34.775439 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:34.775602 (+ 163us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:34.776050 (+ 448us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:34.776054 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:34.776056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:34.776315 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:34.776473 (+ 158us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:34.777161 (+ 688us) server_negotiation.cc:299] Negotiation successful
0807 19:53:34.777384 (+ 223us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":415,"thread_start_us":274,"threads_started":1}
I20260807 19:53:34.778779 10892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:34.759102 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:32995 (local address 127.12.155.130:46621)
0807 19:53:34.760120 (+ 1018us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:34.760177 (+ 57us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:34.762615 (+ 2438us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:34.763411 (+ 796us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:34.763420 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:34.764075 (+ 655us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:34.764702 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:34.764721 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.765910 (+ 1189us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.765914 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:34.767319 (+ 1405us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:34.767334 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:34.768233 (+ 899us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:34.768241 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:34.768494 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:34.769224 (+ 730us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:34.769250 (+ 26us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:34.771608 (+ 2358us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:34.774835 (+ 3227us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:34.774844 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:34.774861 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:34.775292 (+ 431us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:34.775724 (+ 432us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:34.775729 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:34.775733 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:34.775923 (+ 190us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:34.776447 (+ 524us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:34.776454 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:34.776799 (+ 345us) client_negotiation.cc:769] Sending connection context
0807 19:53:34.777057 (+ 258us) client_negotiation.cc:240] Negotiation successful
0807 19:53:34.777591 (+ 534us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":537,"thread_start_us":329,"threads_started":1}
I20260807 19:53:34.780408 10888 heartbeater.cc:347] Connected to a master server at 127.12.155.190:32995
I20260807 19:53:34.780750 10888 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:34.781647 10888 heartbeater.cc:511] Master 127.12.155.190:32995 requested a full tablet report, sending...
I20260807 19:53:34.783504 10375 ts_manager.cc:194] Registered new tserver with Master: 026437adc00844cfa3329451b6ea6368 (127.12.155.130:38705)
I20260807 19:53:34.784855 10375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:46621
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:53:34.830243 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:32995
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:41883
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:35.177565 10896 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:35.177847 10896 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:35.177996 10896 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:35.185316 10896 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:35.185425 10896 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:35.185616 10896 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:35.195536 10896 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:41883
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:32995
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:35.196843 10896 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:35.198225 10896 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:35.212785 10911 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:35.212810 10904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:35.212730 10914 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:35.213819 10896 server_base.cc:1034] running on GCE node
I20260807 19:53:35.214579 10896 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:35.215687 10896 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:35.216938 10896 hybrid_clock.cc:648] HybridClock initialized: now 1786132415216881 us; error 47 us; skew 500 ppm
I20260807 19:53:35.217312 10896 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:35 dist-test-slave-2p8l krb5kdc[10307](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132415, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:35.220896 10896 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:53:35.222461 10896 webserver.cc:460] Webserver started at http://127.12.155.131:37853/ using document root <none> and password file <none>
I20260807 19:53:35.223174 10896 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:35.223289 10896 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:35.223572 10896 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:35.226835 10896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "2c0f8506c5af4e9facacb880701bd6e8"
format_stamp: "Formatted at 2026-08-07 19:53:35 on dist-test-slave-2p8l"
server_key: "1cba74d62ef23288aa44257bf3a6c0b5"
server_key_iv: "7912080bb67df6cdd40d9a45c89c3c2b"
server_key_version: "encryptionkey@0"
I20260807 19:53:35.227671 10896 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "2c0f8506c5af4e9facacb880701bd6e8"
format_stamp: "Formatted at 2026-08-07 19:53:35 on dist-test-slave-2p8l"
server_key: "1cba74d62ef23288aa44257bf3a6c0b5"
server_key_iv: "7912080bb67df6cdd40d9a45c89c3c2b"
server_key_version: "encryptionkey@0"
I20260807 19:53:35.233469 10896 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:53:35.237488 10924 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:35.239223 10896 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:35.239428 10896 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "2c0f8506c5af4e9facacb880701bd6e8"
format_stamp: "Formatted at 2026-08-07 19:53:35 on dist-test-slave-2p8l"
server_key: "1cba74d62ef23288aa44257bf3a6c0b5"
server_key_iv: "7912080bb67df6cdd40d9a45c89c3c2b"
server_key_version: "encryptionkey@0"
I20260807 19:53:35.239636 10896 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:35.257047 10896 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:35.261921 10896 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:35.262228 10688 heartbeater.cc:503] Master 127.12.155.190:32995 was elected leader, sending a full tablet report...
I20260807 19:53:35.262290 10896 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:35.263608 10896 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:35.265372 10896 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:35.265455 10896 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:35.265549 10896 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:35.265612 10896 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:35.302475 10896 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:36103
I20260807 19:53:35.302556 11110 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:36103 every 8 connection(s)
I20260807 19:53:35.303867 10896 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:35.311779 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 10896
I20260807 19:53:35.311990 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:53:35.312445 12910 external_mini_cluster.cc:1428] Setting key 36905efc04d818a2806e0f51d98cea9f
Aug 07 19:53:35 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132415, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:35.325218 11116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.306556 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:46951 (local address 127.12.155.190:32995)
0807 19:53:35.307051 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.307055 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.308030 (+ 975us) server_negotiation.cc:407] Connection header received
0807 19:53:35.309873 (+ 1843us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.309879 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.309975 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.310112 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:35.311583 (+ 1471us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.312505 (+ 922us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.314657 (+ 2152us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.315139 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.315247 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.319040 (+ 3793us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:35.319046 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:35.319050 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:35.319086 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:35.322279 (+ 3193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.323025 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.323029 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.323032 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.323159 (+ 127us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.323641 (+ 482us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.323645 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.323647 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.323920 (+ 273us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:35.324050 (+ 130us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.324744 (+ 694us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.324921 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":258,"threads_started":1}
I20260807 19:53:35.326340 11117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.307096 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:32995 (local address 127.12.155.131:46951)
0807 19:53:35.307862 (+ 766us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.307907 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.309590 (+ 1683us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.310356 (+ 766us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.310364 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.310860 (+ 496us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:35.311399 (+ 539us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.311416 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.312709 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.312714 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.314507 (+ 1793us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.314522 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.315387 (+ 865us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.315398 (+ 11us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.315729 (+ 331us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.316445 (+ 716us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:35.316469 (+ 24us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:35.318842 (+ 2373us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:35.322419 (+ 3577us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:35.322427 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:35.322439 (+ 12us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:35.322902 (+ 463us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:35.323254 (+ 352us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:35.323257 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:35.323260 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:35.323452 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:35.324063 (+ 611us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:35.324069 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:35.324371 (+ 302us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.324619 (+ 248us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.324994 (+ 375us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":328,"threads_started":1}
I20260807 19:53:35.327868 11112 heartbeater.cc:347] Connected to a master server at 127.12.155.190:32995
I20260807 19:53:35.328176 11112 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:35.328866 11112 heartbeater.cc:511] Master 127.12.155.190:32995 requested a full tablet report, sending...
I20260807 19:53:35.330447 10375 ts_manager.cc:194] Registered new tserver with Master: 2c0f8506c5af4e9facacb880701bd6e8 (127.12.155.131:36103)
I20260807 19:53:35.331521 10375 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:46951
I20260807 19:53:35.340478 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:53:35.357703 11116 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.344869 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59512 (local address 127.12.155.190:32995)
0807 19:53:35.345120 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.345127 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.345526 (+ 399us) server_negotiation.cc:407] Connection header received
0807 19:53:35.345634 (+ 108us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.345639 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.345710 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.345792 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:35.347373 (+ 1581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.348088 (+ 715us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.349382 (+ 1294us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.349791 (+ 409us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.349883 (+ 92us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.352537 (+ 2654us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:35.352542 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:35.352545 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:35.352575 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:35.355053 (+ 2478us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.355879 (+ 826us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.355883 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.355885 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.356000 (+ 115us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.356374 (+ 374us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.356377 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.356379 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.356658 (+ 279us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:35.356856 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.357209 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.357365 (+ 156us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:53:35.362026 10375 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59512:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:53:35.368927 10375 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:53:35.393379 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.380662 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52708)
0807 19:53:35.381423 (+ 761us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.381467 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.381652 (+ 185us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.382783 (+ 1131us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.382794 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.382830 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.383311 (+ 481us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.383327 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.385861 (+ 2534us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.385870 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.389131 (+ 3261us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.389161 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.392149 (+ 2988us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.392158 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.392455 (+ 297us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.392542 (+ 87us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.392697 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.392948 (+ 251us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":493,"thread_start_us":323,"threads_started":1}
I20260807 19:53:35.394699 11132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.380962 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52708 (local address 127.12.155.129:37257)
0807 19:53:35.381594 (+ 632us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.381604 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.381635 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:53:35.381925 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.381933 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.382210 (+ 277us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.382406 (+ 196us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.383547 (+ 1141us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.385648 (+ 2101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.389399 (+ 3751us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.391459 (+ 2060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.391716 (+ 257us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.391984 (+ 268us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.394206 (+ 2222us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.394381 (+ 175us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":445,"thread_start_us":694,"threads_started":1}
I20260807 19:53:35.397166 11134 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.381797 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:38705 (local address 127.0.0.1:46240)
0807 19:53:35.382908 (+ 1111us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.382931 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.383081 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.385880 (+ 2799us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.385888 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.385926 (+ 38us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.386561 (+ 635us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.386587 (+ 26us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.390854 (+ 4267us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.390863 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.394693 (+ 3830us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.394705 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.396371 (+ 1666us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.396378 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.396550 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.396588 (+ 38us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.396684 (+ 96us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.396815 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":937,"thread_start_us":12035,"threads_started":1}
I20260807 19:53:35.397238 11135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.382645 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46240 (local address 127.12.155.130:38705)
0807 19:53:35.383728 (+ 1083us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.383739 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.383773 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:53:35.383889 (+ 116us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.383900 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.384164 (+ 264us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.386872 (+ 2708us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.387152 (+ 280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.390656 (+ 3504us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.394849 (+ 4193us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.396169 (+ 1320us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.396351 (+ 182us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.396515 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.396755 (+ 240us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.396916 (+ 161us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":859,"thread_start_us":1047,"threads_started":1}
I20260807 19:53:35.398869 10582 tablet_service.cc:1467] Processing CreateTablet for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 (DEFAULT_TABLE table=test-table [id=8994a3a05ee9474f88a54c4c76401635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:35.400594 10582 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:35.400808 10789 tablet_service.cc:1467] Processing CreateTablet for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 (DEFAULT_TABLE table=test-table [id=8994a3a05ee9474f88a54c4c76401635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:35.401665 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.382264 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:36103 (local address 127.0.0.1:45598)
0807 19:53:35.393963 (+ 11699us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.393987 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.394114 (+ 127us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.395132 (+ 1018us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.395135 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.395154 (+ 19us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.395258 (+ 104us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.395264 (+ 6us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.397005 (+ 1741us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.397009 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.398820 (+ 1811us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.398836 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.400963 (+ 2127us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.400971 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.401157 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.401188 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.401286 (+ 98us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.401413 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11588,"thread_start_us":1267,"threads_started":1}
I20260807 19:53:35.401957 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.383277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45598 (local address 127.12.155.131:36103)
0807 19:53:35.393490 (+ 10213us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.393500 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.394099 (+ 599us) server_negotiation.cc:407] Connection header received
0807 19:53:35.394306 (+ 207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.394314 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.394545 (+ 231us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.394715 (+ 170us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.395411 (+ 696us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.396787 (+ 1376us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.399031 (+ 2244us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.400433 (+ 1402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.400708 (+ 275us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.400863 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.401446 (+ 583us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.401614 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10002,"thread_start_us":10243,"threads_started":1}
I20260807 19:53:35.402056 10789 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:35.405722 11008 tablet_service.cc:1467] Processing CreateTablet for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 (DEFAULT_TABLE table=test-table [id=8994a3a05ee9474f88a54c4c76401635]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:35.407552 11008 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:35.412513 11137 tablet_bootstrap.cc:492] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: Bootstrap starting.
I20260807 19:53:35.416185 11141 tablet_bootstrap.cc:492] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Bootstrap starting.
I20260807 19:53:35.416646 11137 tablet_bootstrap.cc:654] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:35.418004 11137 log.cc:824] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:35.419658 11141 tablet_bootstrap.cc:654] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:35.420940 11141 log.cc:824] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:35.421176 11137 tablet_bootstrap.cc:492] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: No bootstrap required, opened a new log
I20260807 19:53:35.421468 11144 tablet_bootstrap.cc:492] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Bootstrap starting.
I20260807 19:53:35.421482 11137 ts_tablet_manager.cc:1397] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 19:53:35.424391 11144 tablet_bootstrap.cc:654] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:35.425637 11144 log.cc:824] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:35.427275 11141 tablet_bootstrap.cc:492] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: No bootstrap required, opened a new log
I20260807 19:53:35.427563 11141 ts_tablet_manager.cc:1397] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Time spent bootstrapping tablet: real 0.012s user 0.009s sys 0.000s
I20260807 19:53:35.428133 11144 tablet_bootstrap.cc:492] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: No bootstrap required, opened a new log
I20260807 19:53:35.428377 11144 ts_tablet_manager.cc:1397] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Time spent bootstrapping tablet: real 0.007s user 0.002s sys 0.003s
I20260807 19:53:35.432454 11137 raft_consensus.cc:348] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.433027 11137 raft_consensus.cc:374] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:35.433151 11137 raft_consensus.cc:729] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 49b755a2ab124c168ebe234cb58c1b4b, State: Initialized, Role: FOLLOWER
I20260807 19:53:35.433861 11137 consensus_queue.cc:260] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.435695 11137 ts_tablet_manager.cc:1428] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: Time spent starting tablet: real 0.014s user 0.006s sys 0.007s
I20260807 19:53:35.436861 11144 raft_consensus.cc:348] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.437214 11144 raft_consensus.cc:374] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:35.437333 11144 raft_consensus.cc:729] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2c0f8506c5af4e9facacb880701bd6e8, State: Initialized, Role: FOLLOWER
I20260807 19:53:35.437951 11144 consensus_queue.cc:260] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.438400 11141 raft_consensus.cc:348] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.438928 11141 raft_consensus.cc:374] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:35.439093 11141 raft_consensus.cc:729] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 026437adc00844cfa3329451b6ea6368, State: Initialized, Role: FOLLOWER
I20260807 19:53:35.439272 11112 heartbeater.cc:503] Master 127.12.155.190:32995 was elected leader, sending a full tablet report...
I20260807 19:53:35.439913 11144 ts_tablet_manager.cc:1428] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Time spent starting tablet: real 0.011s user 0.011s sys 0.001s
I20260807 19:53:35.439985 11141 consensus_queue.cc:260] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.441210 10888 heartbeater.cc:503] Master 127.12.155.190:32995 was elected leader, sending a full tablet report...
I20260807 19:53:35.442438 11141 ts_tablet_manager.cc:1428] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Time spent starting tablet: real 0.015s user 0.015s sys 0.000s
W20260807 19:53:35.478469 10689 tablet.cc:2369] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:35.508134 10890 tablet.cc:2369] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:35.536629 11153 raft_consensus.cc:482] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:35.537009 11153 raft_consensus.cc:504] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.539058 11153 leader_election.cc:288] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b755a2ab124c168ebe234cb58c1b4b (127.12.155.129:37257), 2c0f8506c5af4e9facacb880701bd6e8 (127.12.155.131:36103)
I20260807 19:53:35.548533 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.539589 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:36805 (local address 127.12.155.131:36103)
0807 19:53:35.539815 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.539821 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.540719 (+ 898us) server_negotiation.cc:407] Connection header received
0807 19:53:35.541240 (+ 521us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.541244 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.541300 (+ 56us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.541368 (+ 68us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.542038 (+ 670us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.543093 (+ 1055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.545995 (+ 2902us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.547329 (+ 1334us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.547506 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.547585 (+ 79us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.548128 (+ 543us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.548260 (+ 132us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:53:35.548738 11155 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.539590 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:36103 (local address 127.12.155.130:36805)
0807 19:53:35.540611 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.540626 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.540790 (+ 164us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.541419 (+ 629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.541429 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.541456 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.541886 (+ 430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.541896 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.543246 (+ 1350us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.543253 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.545836 (+ 2583us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.545845 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.547669 (+ 1824us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.547676 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.547921 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.547978 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.548082 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.548296 (+ 214us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":907,"mutex_wait_us":248,"spinlock_wait_cycles":98304,"thread_start_us":484,"threads_started":1}
I20260807 19:53:35.548774 11149 raft_consensus.cc:482] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:35.549104 11156 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.539597 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.12.155.130:58557)
0807 19:53:35.540588 (+ 991us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.540613 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.540790 (+ 177us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.541101 (+ 311us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.541104 (+ 3us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.541127 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.541468 (+ 341us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.541482 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.542926 (+ 1444us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.542930 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.545809 (+ 2879us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.545828 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.547656 (+ 1828us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.547663 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.547916 (+ 253us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.547975 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.548080 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.548289 (+ 209us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":822,"mutex_wait_us":354,"spinlock_wait_cycles":12160,"thread_start_us":536,"threads_started":1}
I20260807 19:53:35.549086 11149 raft_consensus.cc:504] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.548525 11132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.539717 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:58557 (local address 127.12.155.129:37257)
0807 19:53:35.539912 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.539916 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.540774 (+ 858us) server_negotiation.cc:407] Connection header received
0807 19:53:35.540915 (+ 141us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.540919 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.540988 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.541069 (+ 81us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.541721 (+ 652us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.542781 (+ 1060us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.545989 (+ 3208us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.547359 (+ 1370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.547506 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.547593 (+ 87us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.548124 (+ 531us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.548260 (+ 136us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:53:35.550123 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e2a2dd3b9ed435fa7bd285634fe3a25" candidate_uuid: "026437adc00844cfa3329451b6ea6368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0f8506c5af4e9facacb880701bd6e8" is_pre_election: true
I20260807 19:53:35.550662 11037 raft_consensus.cc:2454] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 026437adc00844cfa3329451b6ea6368 in term 0.
I20260807 19:53:35.550815 10618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e2a2dd3b9ed435fa7bd285634fe3a25" candidate_uuid: "026437adc00844cfa3329451b6ea6368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b755a2ab124c168ebe234cb58c1b4b" is_pre_election: true
I20260807 19:53:35.551343 10728 leader_election.cc:302] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026437adc00844cfa3329451b6ea6368, 2c0f8506c5af4e9facacb880701bd6e8; no voters:
I20260807 19:53:35.551419 11149 leader_election.cc:288] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 49b755a2ab124c168ebe234cb58c1b4b (127.12.155.129:37257), 026437adc00844cfa3329451b6ea6368 (127.12.155.130:38705)
I20260807 19:53:35.551396 10618 raft_consensus.cc:2454] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 026437adc00844cfa3329451b6ea6368 in term 0.
I20260807 19:53:35.551803 11153 raft_consensus.cc:2781] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:53:35.551986 11153 raft_consensus.cc:482] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:53:35.552160 11153 raft_consensus.cc:3037] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:35.555488 11153 raft_consensus.cc:504] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
W20260807 19:53:35.555665 11114 tablet.cc:2369] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:35.556259 11153 leader_election.cc:288] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [CANDIDATE]: Term 1 election: Requested vote from peers 49b755a2ab124c168ebe234cb58c1b4b (127.12.155.129:37257), 2c0f8506c5af4e9facacb880701bd6e8 (127.12.155.131:36103)
I20260807 19:53:35.556921 10618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e2a2dd3b9ed435fa7bd285634fe3a25" candidate_uuid: "026437adc00844cfa3329451b6ea6368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b755a2ab124c168ebe234cb58c1b4b"
I20260807 19:53:35.557148 10618 raft_consensus.cc:3037] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:35.557334 11037 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e2a2dd3b9ed435fa7bd285634fe3a25" candidate_uuid: "026437adc00844cfa3329451b6ea6368" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "2c0f8506c5af4e9facacb880701bd6e8"
I20260807 19:53:35.557545 11037 raft_consensus.cc:3037] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:35.560017 11135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.552703 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:36223 (local address 127.12.155.130:38705)
0807 19:53:35.552893 (+ 190us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.552899 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.552978 (+ 79us) server_negotiation.cc:407] Connection header received
0807 19:53:35.553259 (+ 281us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.553270 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.553346 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.553452 (+ 106us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.554033 (+ 581us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.555188 (+ 1155us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.557688 (+ 2500us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.558980 (+ 1292us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.559148 (+ 168us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.559229 (+ 81us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.559640 (+ 411us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.559777 (+ 137us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
I20260807 19:53:35.560027 10618 raft_consensus.cc:2454] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 026437adc00844cfa3329451b6ea6368 in term 1.
I20260807 19:53:35.560177 11157 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.552166 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:38705 (local address 127.12.155.131:36223)
0807 19:53:35.552886 (+ 720us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.552905 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.553111 (+ 206us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.553479 (+ 368us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.553485 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.553509 (+ 24us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.553853 (+ 344us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.553864 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.555345 (+ 1481us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.555350 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.557505 (+ 2155us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.557522 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.559260 (+ 1738us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.559266 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.559453 (+ 187us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.559488 (+ 35us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.559597 (+ 109us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.559715 (+ 118us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":605,"mutex_wait_us":1,"spinlock_wait_cycles":26880,"thread_start_us":703,"threads_started":1}
I20260807 19:53:35.560536 10727 leader_election.cc:302] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 026437adc00844cfa3329451b6ea6368, 49b755a2ab124c168ebe234cb58c1b4b; no voters:
I20260807 19:53:35.560866 11153 raft_consensus.cc:2781] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:35.560887 11037 raft_consensus.cc:2454] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 026437adc00844cfa3329451b6ea6368 in term 1.
I20260807 19:53:35.561093 10824 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e2a2dd3b9ed435fa7bd285634fe3a25" candidate_uuid: "2c0f8506c5af4e9facacb880701bd6e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "026437adc00844cfa3329451b6ea6368" is_pre_election: true
I20260807 19:53:35.562680 11153 raft_consensus.cc:686] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 1 LEADER]: Becoming Leader. State: Replica: 026437adc00844cfa3329451b6ea6368, State: Running, Role: LEADER
I20260807 19:53:35.563194 11117 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.551742 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.12.155.131:33425)
0807 19:53:35.552083 (+ 341us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.552104 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:35.552218 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:35.553009 (+ 791us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:35.553014 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:35.553041 (+ 27us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:35.553239 (+ 198us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.553254 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.554615 (+ 1361us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.554621 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.556348 (+ 1727us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:35.556366 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.562599 (+ 6233us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.562605 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:35.562778 (+ 173us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.562834 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 19:53:35.562923 (+ 89us) client_negotiation.cc:240] Negotiation successful
0807 19:53:35.563017 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":191}
I20260807 19:53:35.563266 11153 consensus_queue.cc:237] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } }
I20260807 19:53:35.563607 11132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.552496 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:33425 (local address 127.12.155.129:37257)
0807 19:53:35.552704 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.552709 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.552727 (+ 18us) server_negotiation.cc:407] Connection header received
0807 19:53:35.552786 (+ 59us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.552791 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.552859 (+ 68us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.553348 (+ 489us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:35.553495 (+ 147us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.554477 (+ 982us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.556594 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.562402 (+ 5808us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.562552 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.562602 (+ 50us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.562971 (+ 369us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.563112 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:53:35.564083 10618 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e2a2dd3b9ed435fa7bd285634fe3a25" candidate_uuid: "2c0f8506c5af4e9facacb880701bd6e8" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "49b755a2ab124c168ebe234cb58c1b4b" is_pre_election: true
I20260807 19:53:35.564368 10618 raft_consensus.cc:2379] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 2c0f8506c5af4e9facacb880701bd6e8 in current term 1: Already voted for candidate 026437adc00844cfa3329451b6ea6368 in this term.
I20260807 19:53:35.567152 10929 leader_election.cc:302] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 2c0f8506c5af4e9facacb880701bd6e8; no voters: 026437adc00844cfa3329451b6ea6368, 49b755a2ab124c168ebe234cb58c1b4b
I20260807 19:53:35.567524 11149 raft_consensus.cc:2726] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20260807 19:53:35.568572 10375 catalog_manager.cc:5495] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 reported cstate change: term changed from 0 to 1, leader changed from <none> to 026437adc00844cfa3329451b6ea6368 (127.12.155.130). New cstate: current_term: 1 leader_uuid: "026437adc00844cfa3329451b6ea6368" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "026437adc00844cfa3329451b6ea6368" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 38705 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 } health_report { overall_health: UNKNOWN } } }
I20260807 19:53:35.587961 11135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.581635 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46248 (local address 127.12.155.130:38705)
0807 19:53:35.581822 (+ 187us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.581829 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.581958 (+ 129us) server_negotiation.cc:407] Connection header received
0807 19:53:35.582169 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.582175 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.582269 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.582403 (+ 134us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:53:35.582797 (+ 394us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.583890 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.585357 (+ 1467us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.585966 (+ 609us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.586136 (+ 170us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.586648 (+ 512us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:53:35.587326 (+ 678us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:53:35.587509 (+ 183us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.587627 (+ 118us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.587675 (+ 48us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:53:35.596406 10618 raft_consensus.cc:1261] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 1 FOLLOWER]: Refusing update from remote peer 026437adc00844cfa3329451b6ea6368: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:35.596441 11037 raft_consensus.cc:1261] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 1 FOLLOWER]: Refusing update from remote peer 026437adc00844cfa3329451b6ea6368: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:35.597340 11158 consensus_queue.cc:1035] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "2c0f8506c5af4e9facacb880701bd6e8" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 36103 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:35.597747 11153 consensus_queue.cc:1035] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [LEADER]: Connected to new peer: Peer: permanent_uuid: "49b755a2ab124c168ebe234cb58c1b4b" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37257 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:35.608896 11162 mvcc.cc:205] Tried to move back new op lower bound from 7315998374272917504 to 7315998374151974912. Current Snapshot: MvccSnapshot[applied={T|T < 7315998374272917504}]
I20260807 19:53:35.613746 11163 mvcc.cc:205] Tried to move back new op lower bound from 7315998374272917504 to 7315998374151974912. Current Snapshot: MvccSnapshot[applied={T|T < 7315998374272917504 or (T in {7315998374272917504})}]
I20260807 19:53:35.625373 10375 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59512:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:35.625694 10375 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:59512:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:35.630014 10375 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 255494914ac54d089b2d50d9c8702c23: Sending DeleteTablet for 3 replicas of tablet 1e2a2dd3b9ed435fa7bd285634fe3a25
I20260807 19:53:35.631367 10582 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:35 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:52708
I20260807 19:53:35.631621 10789 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:35 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:46240
I20260807 19:53:35.632790 11008 tablet_service.cc:1514] Processing DeleteTablet for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:35 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:45598
I20260807 19:53:35.632956 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 10476
I20260807 19:53:35.656160 11177 tablet_replica.cc:330] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: stopping tablet replica
I20260807 19:53:35.656837 11177 raft_consensus.cc:2229] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:35.661659 11177 raft_consensus.cc:2258] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8 [term 1 FOLLOWER]: Raft consensus is shut down!
Aug 07 19:53:35 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:53:35.663007 11176 tablet_replica.cc:330] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: stopping tablet replica
I20260807 19:53:35.663527 11176 raft_consensus.cc:2229] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:53:35.664511 11177 ts_tablet_manager.cc:1905] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:35.664566 11176 raft_consensus.cc:2258] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:35.667107 11176 ts_tablet_manager.cc:1905] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:35.671972 11177 ts_tablet_manager.cc:1918] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:35.672169 11177 log.cc:1196] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/1e2a2dd3b9ed435fa7bd285634fe3a25
I20260807 19:53:35.672755 11177 ts_tablet_manager.cc:1939] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 2c0f8506c5af4e9facacb880701bd6e8: Deleting consensus metadata
I20260807 19:53:35.673245 11132 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.634626 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52716 (local address 127.12.155.129:37257)
0807 19:53:35.636065 (+ 1439us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.636076 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.646022 (+ 9946us) server_negotiation.cc:407] Connection header received
0807 19:53:35.646609 (+ 587us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.646621 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.646734 (+ 113us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.646826 (+ 92us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:35.649109 (+ 2283us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.650647 (+ 1538us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.653300 (+ 2653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.654271 (+ 971us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.654404 (+ 133us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.664213 (+ 9809us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:35.664236 (+ 23us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:35.664259 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:35.664322 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:35.668760 (+ 4438us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.669908 (+ 1148us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.669921 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.669926 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.670137 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.670669 (+ 532us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.670675 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.670679 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.671177 (+ 498us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:35.671514 (+ 337us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.672432 (+ 918us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.672718 (+ 286us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1241}
I20260807 19:53:35.674998 10359 catalog_manager.cc:4841] TS 2c0f8506c5af4e9facacb880701bd6e8 (127.12.155.131:36103): tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 (table test-table [id=8994a3a05ee9474f88a54c4c76401635]) successfully deleted
I20260807 19:53:35.675653 11175 tablet_replica.cc:330] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b: stopping tablet replica
I20260807 19:53:35.675673 10679 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:35.677058 11176 ts_tablet_manager.cc:1918] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:35.677335 11176 log.cc:1196] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_2.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/1e2a2dd3b9ed435fa7bd285634fe3a25
I20260807 19:53:35.677958 11176 ts_tablet_manager.cc:1939] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 026437adc00844cfa3329451b6ea6368: Deleting consensus metadata
I20260807 19:53:35.679956 10357 catalog_manager.cc:4841] TS 026437adc00844cfa3329451b6ea6368 (127.12.155.130:38705): tablet 1e2a2dd3b9ed435fa7bd285634fe3a25 (table test-table [id=8994a3a05ee9474f88a54c4c76401635]) successfully deleted
I20260807 19:53:35.676299 11175 raft_consensus.cc:2229] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:35.779376 11175 raft_consensus.cc:2258] T 1e2a2dd3b9ed435fa7bd285634fe3a25 P 49b755a2ab124c168ebe234cb58c1b4b [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:35.779495 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 10476
W20260807 19:53:35.812036 10357 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:37257 (error 108)
I20260807 19:53:35.812909 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 10699
I20260807 19:53:35.814254 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.813609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52728)
0807 19:53:35.813911 (+ 302us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.814027 (+ 116us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":156}
W20260807 19:53:35.814533 10357 catalog_manager.cc:4584] TS 49b755a2ab124c168ebe234cb58c1b4b (127.12.155.129:37257): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 1e2a2dd3b9ed435fa7bd285634fe3a25: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Aug 07 19:53:35 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:53:35.830426 11135 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.813700 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46252 (local address 127.12.155.130:38705)
0807 19:53:35.813941 (+ 241us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.813949 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.814000 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:53:35.814251 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.814262 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.814352 (+ 90us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.814458 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:35.816049 (+ 1591us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.816786 (+ 737us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.818211 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.818673 (+ 462us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.818842 (+ 169us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.823936 (+ 5094us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:35.823951 (+ 15us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:35.823977 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:35.824023 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:35.827537 (+ 3514us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.828228 (+ 691us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.828246 (+ 18us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.828249 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.828372 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.828759 (+ 387us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.828765 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.828768 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.829172 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:35.829507 (+ 335us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.829798 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.830044 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260807 19:53:35.831238 10882 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:35.868470 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.867974 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52732)
0807 19:53:35.868203 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.868303 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":85}
I20260807 19:53:35.869575 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.869203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52744)
0807 19:53:35.869357 (+ 154us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.869424 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":48}
I20260807 19:53:35.930102 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.929602 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52750)
0807 19:53:35.929818 (+ 216us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.929908 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":75}
I20260807 19:53:35.931185 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.930833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52764)
0807 19:53:35.930982 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:35.931054 (+ 72us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:53:35.948290 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 10699
I20260807 19:53:35.973647 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 10896
Aug 07 19:53:35 dist-test-slave-2p8l krb5kdc[10307](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132413, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:53:35.989598 11136 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:35.974489 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:45602 (local address 127.12.155.131:36103)
0807 19:53:35.974703 (+ 214us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:35.974707 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:35.974730 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:53:35.974888 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:35.974892 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:35.974956 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:35.975050 (+ 94us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:35.976447 (+ 1397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.977198 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.978679 (+ 1481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:35.979049 (+ 370us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:35.979146 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:35.983639 (+ 4493us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:35.983653 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:35.983670 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:35.983706 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:35.986581 (+ 2875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.987313 (+ 732us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.987322 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.987324 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.987486 (+ 162us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:35.987935 (+ 449us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:35.987938 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:35.987940 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:35.988337 (+ 397us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:35.988604 (+ 267us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:35.988964 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 19:53:35.989132 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":104}
I20260807 19:53:35.990285 11097 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:36.011930 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:36.011426 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52780)
0807 19:53:36.011680 (+ 254us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:36.011776 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 19:53:36.013080 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:36.012641 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:52796)
0807 19:53:36.012846 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:36.012923 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":98}
I20260807 19:53:36.081857 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 10896
I20260807 19:53:36.107700 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 10326
I20260807 19:53:36.109026 10414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:36.219553 11131 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:36.218837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37257 (local address 127.0.0.1:48734)
0807 19:53:36.219153 (+ 316us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:36.219336 (+ 183us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37257: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":123}
I20260807 19:53:36.219975 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 10326
2026-08-07T19:53:36Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/2 (4812 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/3
2026-08-07T19:53:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:36Z Disabled control of system clock
I20260807 19:53:36.315949 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:41497
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:41497
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 19:53:36.658720 11191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:36.659011 11191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:36.659096 11191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:36.666311 11191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:36.666414 11191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:36.666452 11191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:36.666517 11191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:36.666563 11191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:36.675518 11191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:41497
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:41497
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:36.676720 11191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:36.678519 11191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:36.690640 11198 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:36.690670 11201 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:36.690636 11199 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:36.691561 11191 server_base.cc:1034] running on GCE node
I20260807 19:53:36.692413 11191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:36.694015 11191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:36.695322 11191 hybrid_clock.cc:648] HybridClock initialized: now 1786132416695277 us; error 40 us; skew 500 ppm
I20260807 19:53:36.695720 11191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:36.698179 11191 webserver.cc:460] Webserver started at http://127.12.155.190:40625/ using document root <none> and password file <none>
I20260807 19:53:36.698863 11191 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:36.698977 11191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:36.699316 11191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:36.702263 11191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "9e357bb5b5324621b4c458a33d46f871"
format_stamp: "Formatted at 2026-08-07 19:53:36 on dist-test-slave-2p8l"
server_key: "05685c9aa0fe846e6f9e0599b6b33bd2"
server_key_iv: "929ff280541093fa8efdad031b360120"
server_key_version: "encryptionkey@0"
I20260807 19:53:36.703105 11191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "9e357bb5b5324621b4c458a33d46f871"
format_stamp: "Formatted at 2026-08-07 19:53:36 on dist-test-slave-2p8l"
server_key: "05685c9aa0fe846e6f9e0599b6b33bd2"
server_key_iv: "929ff280541093fa8efdad031b360120"
server_key_version: "encryptionkey@0"
I20260807 19:53:36.708341 11191 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:53:36.711931 11208 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:36.713222 11191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:53:36.713407 11191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "9e357bb5b5324621b4c458a33d46f871"
format_stamp: "Formatted at 2026-08-07 19:53:36 on dist-test-slave-2p8l"
server_key: "05685c9aa0fe846e6f9e0599b6b33bd2"
server_key_iv: "929ff280541093fa8efdad031b360120"
server_key_version: "encryptionkey@0"
I20260807 19:53:36.713630 11191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:36.740283 11191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:36.741104 11191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:36.741401 11191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:36.760978 11191 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:41497
I20260807 19:53:36.760998 11294 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:41497 every 8 connection(s)
I20260807 19:53:36.762375 11191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:36.764623 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 11191
I20260807 19:53:36.764806 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:36.765323 12910 external_mini_cluster.cc:1428] Setting key 2f4276b08ad4ae4445b42fb39c9911f8
I20260807 19:53:36.766759 11295 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:36.783325 11302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:36.767361 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47616 (local address 127.12.155.190:41497)
0807 19:53:36.768488 (+ 1127us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:36.768503 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:36.768556 (+ 53us) server_negotiation.cc:407] Connection header received
0807 19:53:36.770624 (+ 2068us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:36.770654 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:36.771299 (+ 645us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:36.771752 (+ 453us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:36.772329 (+ 577us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:36.774641 (+ 2312us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:36.776919 (+ 2278us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:36.777945 (+ 1026us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:36.778165 (+ 220us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:36.779966 (+ 1801us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:36.779978 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:36.780001 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:36.780763 (+ 762us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:36.780913 (+ 150us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:36.780944 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:36.781111 (+ 167us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:36.781429 (+ 318us) server_negotiation.cc:299] Negotiation successful
0807 19:53:36.781800 (+ 371us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":384,"threads_started":1}
I20260807 19:53:36.784909 11295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871: Bootstrap starting.
I20260807 19:53:36.789326 11295 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:36.790870 11295 log.cc:824] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:36.795949 11295 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871: No bootstrap required, opened a new log
I20260807 19:53:36.808415 11295 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e357bb5b5324621b4c458a33d46f871" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41497 } }
I20260807 19:53:36.808938 11295 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:36.809073 11295 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9e357bb5b5324621b4c458a33d46f871, State: Initialized, Role: FOLLOWER
I20260807 19:53:36.809763 11295 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e357bb5b5324621b4c458a33d46f871" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41497 } }
I20260807 19:53:36.810016 11295 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:36.810209 11295 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:36.810453 11295 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:36.812887 11295 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e357bb5b5324621b4c458a33d46f871" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41497 } }
I20260807 19:53:36.813429 11295 leader_election.cc:302] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9e357bb5b5324621b4c458a33d46f871; no voters:
I20260807 19:53:36.814112 11295 leader_election.cc:288] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:36.814277 11305 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:36.815155 11305 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [term 1 LEADER]: Becoming Leader. State: Replica: 9e357bb5b5324621b4c458a33d46f871, State: Running, Role: LEADER
I20260807 19:53:36.815833 11305 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e357bb5b5324621b4c458a33d46f871" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41497 } }
I20260807 19:53:36.816748 11295 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:36.820041 11307 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9e357bb5b5324621b4c458a33d46f871. Latest consensus state: current_term: 1 leader_uuid: "9e357bb5b5324621b4c458a33d46f871" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e357bb5b5324621b4c458a33d46f871" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41497 } } }
I20260807 19:53:36.820573 11307 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:36.833719 11315 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:36.833653 11306 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9e357bb5b5324621b4c458a33d46f871" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9e357bb5b5324621b4c458a33d46f871" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41497 } } }
I20260807 19:53:36.834216 11306 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:36.839692 11315 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:36.848469 11315 catalog_manager.cc:1347] Generated new cluster ID: c7e6d5c07f174b89ad24e3572575940a
I20260807 19:53:36.848618 11315 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:36.876024 11315 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:36.877875 11315 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:36.885317 11315 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871: Generated new TSK 0
I20260807 19:53:36.886292 11315 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:36.896615 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41497
--builtin_ntp_servers=127.12.155.148:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 19:53:37.255622 11328 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:37.255982 11328 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:37.256151 11328 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:37.263329 11328 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:37.263470 11328 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:37.263640 11328 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:37.272650 11328 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:37.273960 11328 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:37.275782 11328 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:37.289129 11335 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:37.289100 11338 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:37.289064 11336 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:37.290150 11328 server_base.cc:1034] running on GCE node
I20260807 19:53:37.290751 11328 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:37.291668 11328 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:37.292918 11328 hybrid_clock.cc:648] HybridClock initialized: now 1786132417292865 us; error 56 us; skew 500 ppm
I20260807 19:53:37.293249 11328 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:37.295616 11328 webserver.cc:460] Webserver started at http://127.12.155.129:41137/ using document root <none> and password file <none>
I20260807 19:53:37.296314 11328 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:37.296447 11328 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:37.296775 11328 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:37.299836 11328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "060cb66f8d494c5a86b555f44ff82fac"
format_stamp: "Formatted at 2026-08-07 19:53:37 on dist-test-slave-2p8l"
server_key: "83f4301f60c9c5d5768c7e6cd3c58b42"
server_key_iv: "ca5adc700ba5fc85d4822734032d3193"
server_key_version: "encryptionkey@0"
I20260807 19:53:37.300647 11328 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "060cb66f8d494c5a86b555f44ff82fac"
format_stamp: "Formatted at 2026-08-07 19:53:37 on dist-test-slave-2p8l"
server_key: "83f4301f60c9c5d5768c7e6cd3c58b42"
server_key_iv: "ca5adc700ba5fc85d4822734032d3193"
server_key_version: "encryptionkey@0"
I20260807 19:53:37.305887 11328 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:53:37.309415 11352 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:37.310896 11328 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:37.311076 11328 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "060cb66f8d494c5a86b555f44ff82fac"
format_stamp: "Formatted at 2026-08-07 19:53:37 on dist-test-slave-2p8l"
server_key: "83f4301f60c9c5d5768c7e6cd3c58b42"
server_key_iv: "ca5adc700ba5fc85d4822734032d3193"
server_key_version: "encryptionkey@0"
I20260807 19:53:37.311298 11328 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:37.326835 11328 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:37.327656 11328 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:37.327971 11328 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:37.328963 11328 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:37.330494 11328 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:37.330618 11328 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:37.330761 11328 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:37.330849 11328 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:37.365016 11328 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:37409
I20260807 19:53:37.365069 11541 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:37409 every 8 connection(s)
I20260807 19:53:37.366389 11328 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:37.369061 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 11328
I20260807 19:53:37.369270 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:53:37.369726 12910 external_mini_cluster.cc:1428] Setting key a9de1a354ae3efff5ca65446f9efa168
I20260807 19:53:37.373132 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41497
--builtin_ntp_servers=127.12.155.148:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 19:53:37.382712 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:37.369193 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:58975 (local address 127.12.155.190:41497)
0807 19:53:37.374432 (+ 5239us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:37.374436 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:37.374459 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:53:37.374505 (+ 46us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:37.374509 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:37.374567 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:37.374657 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:37.376153 (+ 1496us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.376928 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.379463 (+ 2535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.379974 (+ 511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.380097 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:37.381828 (+ 1731us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:37.381833 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:37.381836 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:37.381860 (+ 24us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:37.381901 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:37.381913 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:37.381987 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:37.382294 (+ 307us) server_negotiation.cc:299] Negotiation successful
0807 19:53:37.382382 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":5131,"thread_start_us":5022,"threads_started":1}
I20260807 19:53:37.384102 11554 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:37.369882 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:41497 (local address 127.12.155.129:58975)
0807 19:53:37.371202 (+ 1320us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:37.371249 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:37.373649 (+ 2400us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:37.374942 (+ 1293us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:37.374957 (+ 15us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:37.375081 (+ 124us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:37.375921 (+ 840us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:37.375949 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.377092 (+ 1143us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.377100 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:37.379288 (+ 2188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:37.379307 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.380255 (+ 948us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.380267 (+ 12us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:37.380612 (+ 345us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:37.381445 (+ 833us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:37.381450 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:37.381504 (+ 54us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:37.381613 (+ 109us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:37.382012 (+ 399us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:37.382026 (+ 14us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:37.382036 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 19:53:37.382258 (+ 222us) client_negotiation.cc:240] Negotiation successful
0807 19:53:37.382691 (+ 433us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":736,"thread_start_us":493,"threads_started":1}
I20260807 19:53:37.386008 11549 heartbeater.cc:347] Connected to a master server at 127.12.155.190:41497
I20260807 19:53:37.386329 11549 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:37.387079 11549 heartbeater.cc:511] Master 127.12.155.190:41497 requested a full tablet report, sending...
I20260807 19:53:37.389376 11234 ts_manager.cc:194] Registered new tserver with Master: 060cb66f8d494c5a86b555f44ff82fac (127.12.155.129:37409)
I20260807 19:53:37.391577 11234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.129:58975
W20260807 19:53:37.722397 11557 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:37.722702 11557 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:37.722790 11557 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:37.729832 11557 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:37.729928 11557 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:37.730031 11557 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:37.739188 11557 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:37.740406 11557 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:37.742166 11557 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:37.756054 11564 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:37.756162 11565 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:37.756067 11568 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:37.756811 11557 server_base.cc:1034] running on GCE node
I20260807 19:53:37.757476 11557 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:37.758477 11557 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:37.759716 11557 hybrid_clock.cc:648] HybridClock initialized: now 1786132417759666 us; error 39 us; skew 500 ppm
I20260807 19:53:37.760040 11557 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:37.762470 11557 webserver.cc:460] Webserver started at http://127.12.155.130:41665/ using document root <none> and password file <none>
I20260807 19:53:37.763172 11557 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:37.763301 11557 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:37.763620 11557 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:37.766561 11557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "9d0cf9d0aaf443bf923c757032e7c2ca"
format_stamp: "Formatted at 2026-08-07 19:53:37 on dist-test-slave-2p8l"
server_key: "bf5afc298348da26da8dffa33ae94ea9"
server_key_iv: "16b5c3fb369f2e52d65419b2056f6524"
server_key_version: "encryptionkey@0"
I20260807 19:53:37.767357 11557 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "9d0cf9d0aaf443bf923c757032e7c2ca"
format_stamp: "Formatted at 2026-08-07 19:53:37 on dist-test-slave-2p8l"
server_key: "bf5afc298348da26da8dffa33ae94ea9"
server_key_iv: "16b5c3fb369f2e52d65419b2056f6524"
server_key_version: "encryptionkey@0"
I20260807 19:53:37.772564 11557 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 19:53:37.776090 11576 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:37.777402 11557 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:53:37.777583 11557 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "9d0cf9d0aaf443bf923c757032e7c2ca"
format_stamp: "Formatted at 2026-08-07 19:53:37 on dist-test-slave-2p8l"
server_key: "bf5afc298348da26da8dffa33ae94ea9"
server_key_iv: "16b5c3fb369f2e52d65419b2056f6524"
server_key_version: "encryptionkey@0"
I20260807 19:53:37.777799 11557 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:37.791200 11557 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:37.792042 11557 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:37.792366 11557 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:37.793327 11557 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:37.794876 11557 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:37.794998 11557 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:37.795135 11557 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:37.795224 11557 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:37.830555 11557 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:44239
I20260807 19:53:37.830621 11755 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:44239 every 8 connection(s)
I20260807 19:53:37.831907 11557 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:37.836988 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 11557
I20260807 19:53:37.837173 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:53:37.837626 12910 external_mini_cluster.cc:1428] Setting key 9570d603a962f00cf0a7d58910c36483
I20260807 19:53:37.840703 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41497
--builtin_ntp_servers=127.12.155.148:42415
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 19:53:37.845886 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:37.834528 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:49409 (local address 127.12.155.190:41497)
0807 19:53:37.834770 (+ 242us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:37.834776 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:37.836120 (+ 1344us) server_negotiation.cc:407] Connection header received
0807 19:53:37.838039 (+ 1919us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:37.838045 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:37.838161 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:37.838274 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:37.839489 (+ 1215us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.840340 (+ 851us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.842897 (+ 2557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.843305 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.843405 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:37.845109 (+ 1704us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:37.845114 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:37.845117 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:37.845134 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:37.845167 (+ 33us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:37.845178 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:37.845249 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:37.845544 (+ 295us) server_negotiation.cc:299] Negotiation successful
0807 19:53:37.845633 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:53:37.847332 11759 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:37.835050 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:41497 (local address 127.12.155.130:49409)
0807 19:53:37.835959 (+ 909us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:37.836001 (+ 42us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:37.837783 (+ 1782us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:37.838535 (+ 752us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:37.838546 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:37.838658 (+ 112us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:37.839285 (+ 627us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:37.839314 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.840509 (+ 1195us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.840514 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:37.842747 (+ 2233us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:37.842766 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:37.843528 (+ 762us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:37.843538 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:37.843871 (+ 333us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:37.844733 (+ 862us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:37.844739 (+ 6us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:37.844794 (+ 55us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:37.844893 (+ 99us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:37.845275 (+ 382us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:37.845288 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:37.845298 (+ 10us) client_negotiation.cc:769] Sending connection context
0807 19:53:37.845484 (+ 186us) client_negotiation.cc:240] Negotiation successful
0807 19:53:37.845895 (+ 411us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":487,"thread_start_us":305,"threads_started":1}
I20260807 19:53:37.848791 11757 heartbeater.cc:347] Connected to a master server at 127.12.155.190:41497
I20260807 19:53:37.849141 11757 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:37.849938 11757 heartbeater.cc:511] Master 127.12.155.190:41497 requested a full tablet report, sending...
I20260807 19:53:37.851696 11234 ts_manager.cc:194] Registered new tserver with Master: 9d0cf9d0aaf443bf923c757032e7c2ca (127.12.155.130:44239)
I20260807 19:53:37.852602 11234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.130:49409
W20260807 19:53:38.186538 11760 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:38.186851 11760 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:38.187016 11760 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:38.194216 11760 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:38.194344 11760 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:38.194509 11760 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:38.203624 11760 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42415
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:41497
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:38.204978 11760 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:38.206904 11760 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:38.221102 11772 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:38.221247 11770 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:38.221145 11769 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:38.222347 11760 server_base.cc:1034] running on GCE node
I20260807 19:53:38.223029 11760 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:38.224082 11760 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:38.225333 11760 hybrid_clock.cc:648] HybridClock initialized: now 1786132418225281 us; error 61 us; skew 500 ppm
I20260807 19:53:38.225699 11760 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:38.228245 11760 webserver.cc:460] Webserver started at http://127.12.155.131:41421/ using document root <none> and password file <none>
I20260807 19:53:38.229075 11760 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:38.229225 11760 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:38.229585 11760 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:38.232829 11760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "cff8225600884bbe9689aafb7010be82"
format_stamp: "Formatted at 2026-08-07 19:53:38 on dist-test-slave-2p8l"
server_key: "edc2be84b4528630f5f8227333f638ee"
server_key_iv: "ade0892149061893126f04325a88e751"
server_key_version: "encryptionkey@0"
I20260807 19:53:38.233726 11760 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "cff8225600884bbe9689aafb7010be82"
format_stamp: "Formatted at 2026-08-07 19:53:38 on dist-test-slave-2p8l"
server_key: "edc2be84b4528630f5f8227333f638ee"
server_key_iv: "ade0892149061893126f04325a88e751"
server_key_version: "encryptionkey@0"
I20260807 19:53:38.239490 11760 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:53:38.243769 11785 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:38.245185 11760 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:38.245393 11760 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "cff8225600884bbe9689aafb7010be82"
format_stamp: "Formatted at 2026-08-07 19:53:38 on dist-test-slave-2p8l"
server_key: "edc2be84b4528630f5f8227333f638ee"
server_key_iv: "ade0892149061893126f04325a88e751"
server_key_version: "encryptionkey@0"
I20260807 19:53:38.245618 11760 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:38.278210 11760 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:38.279098 11760 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:38.279407 11760 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:38.280423 11760 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:38.281991 11760 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:38.282135 11760 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.001s sys 0.000s
I20260807 19:53:38.282260 11760 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:38.282353 11760 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:38.316915 11760 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:38707
I20260807 19:53:38.317090 11954 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:38707 every 8 connection(s)
I20260807 19:53:38.318405 11760 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:38.324491 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 11760
I20260807 19:53:38.324673 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:53:38.325294 12910 external_mini_cluster.cc:1428] Setting key c7e894ae9e78ac1adfd2085919dc12c4
I20260807 19:53:38.331583 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.321093 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:56429 (local address 127.12.155.190:41497)
0807 19:53:38.321297 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.321301 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.322832 (+ 1531us) server_negotiation.cc:407] Connection header received
0807 19:53:38.324934 (+ 2102us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.324939 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.325006 (+ 67us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.325133 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:38.326401 (+ 1268us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.327245 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.328951 (+ 1706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.329384 (+ 433us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.329492 (+ 108us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.330907 (+ 1415us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:38.330911 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:38.330915 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:38.330932 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:38.330961 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:38.330972 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:38.331046 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.331262 (+ 216us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.331338 (+ 76us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:53:38.332525 11963 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.321659 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:41497 (local address 127.12.155.131:56429)
0807 19:53:38.322680 (+ 1021us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.322724 (+ 44us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:38.324625 (+ 1901us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:38.325410 (+ 785us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:38.325421 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:38.325539 (+ 118us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:38.326243 (+ 704us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.326261 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.327394 (+ 1133us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.327398 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.328792 (+ 1394us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.328810 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.329644 (+ 834us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.329650 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.329847 (+ 197us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.330611 (+ 764us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:38.330614 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:38.330651 (+ 37us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:38.330727 (+ 76us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:38.331058 (+ 331us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:38.331066 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:38.331072 (+ 6us) client_negotiation.cc:769] Sending connection context
0807 19:53:38.331203 (+ 131us) client_negotiation.cc:240] Negotiation successful
0807 19:53:38.331466 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":518,"thread_start_us":304,"threads_started":1}
I20260807 19:53:38.333791 11960 heartbeater.cc:347] Connected to a master server at 127.12.155.190:41497
I20260807 19:53:38.334132 11960 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:38.334851 11960 heartbeater.cc:511] Master 127.12.155.190:41497 requested a full tablet report, sending...
I20260807 19:53:38.336187 11234 ts_manager.cc:194] Registered new tserver with Master: cff8225600884bbe9689aafb7010be82 (127.12.155.131:38707)
I20260807 19:53:38.336992 11234 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.131:56429
I20260807 19:53:38.340517 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:53:38.350936 11553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.344686 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47618 (local address 127.12.155.190:41497)
0807 19:53:38.344878 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.344885 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.345319 (+ 434us) server_negotiation.cc:407] Connection header received
0807 19:53:38.345503 (+ 184us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.345509 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.345580 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.345683 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:38.346269 (+ 586us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.346959 (+ 690us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.348367 (+ 1408us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.348806 (+ 439us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.348937 (+ 131us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.350166 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:38.350171 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:38.350174 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:38.350191 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:38.350220 (+ 29us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:38.350231 (+ 11us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:38.350384 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.350652 (+ 268us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.350723 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":55}
I20260807 19:53:38.354660 11234 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:47618:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:53:38.361434 11234 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:53:38.384817 11984 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.375415 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:44239 (local address 127.0.0.1:52586)
0807 19:53:38.375943 (+ 528us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.375962 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:38.376076 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:38.377203 (+ 1127us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:38.377211 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:38.377247 (+ 36us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:38.377808 (+ 561us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.377824 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.380053 (+ 2229us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.380058 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.382314 (+ 2256us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.382327 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.383735 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.383741 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.383945 (+ 204us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.384002 (+ 57us) client_negotiation.cc:769] Sending connection context
0807 19:53:38.384136 (+ 134us) client_negotiation.cc:240] Negotiation successful
0807 19:53:38.384344 (+ 208us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":393,"mutex_wait_us":3,"thread_start_us":354,"threads_started":1}
I20260807 19:53:38.385205 11980 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.374028 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38707 (local address 127.0.0.1:38318)
0807 19:53:38.375042 (+ 1014us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.375097 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:38.375265 (+ 168us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:38.376510 (+ 1245us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:38.376522 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:38.376555 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:38.376895 (+ 340us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.376911 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.379104 (+ 2193us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.379112 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.382509 (+ 3397us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.382521 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.384347 (+ 1826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.384353 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.384561 (+ 208us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.384590 (+ 29us) client_negotiation.cc:769] Sending connection context
0807 19:53:38.384684 (+ 94us) client_negotiation.cc:240] Negotiation successful
0807 19:53:38.384843 (+ 159us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":792,"mutex_wait_us":641,"thread_start_us":599,"threads_started":1}
I20260807 19:53:38.385344 11983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.374305 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38318 (local address 127.12.155.131:38707)
0807 19:53:38.375834 (+ 1529us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.375845 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.375888 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:53:38.375986 (+ 98us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.375993 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.376249 (+ 256us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.377132 (+ 883us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:38.377626 (+ 494us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.378962 (+ 1336us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.382686 (+ 3724us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.384155 (+ 1469us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.384362 (+ 207us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.384560 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.384764 (+ 204us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.384955 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1315,"thread_start_us":1152,"threads_started":1}
I20260807 19:53:38.386027 11986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.375996 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52586 (local address 127.12.155.130:44239)
0807 19:53:38.376576 (+ 580us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.376583 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.376610 (+ 27us) server_negotiation.cc:407] Connection header received
0807 19:53:38.376710 (+ 100us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.376718 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.376936 (+ 218us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.378099 (+ 1163us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:38.378405 (+ 306us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.379918 (+ 1513us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.382497 (+ 2579us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.383519 (+ 1022us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.383695 (+ 176us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.383930 (+ 235us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.385473 (+ 1543us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.385665 (+ 192us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":312,"threads_started":1}
I20260807 19:53:38.387931 11987 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.376088 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49002)
0807 19:53:38.379541 (+ 3453us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.379558 (+ 17us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:38.379704 (+ 146us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:38.380269 (+ 565us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:38.380274 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:38.380300 (+ 26us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:38.380768 (+ 468us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.380777 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.382728 (+ 1951us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.382735 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.384822 (+ 2087us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.384836 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.387202 (+ 2366us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.387209 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.387381 (+ 172us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.387411 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:53:38.387506 (+ 95us) client_negotiation.cc:240] Negotiation successful
0807 19:53:38.387646 (+ 140us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":3325,"thread_start_us":3167,"threads_started":1}
I20260807 19:53:38.388399 11988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.376657 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49002 (local address 127.12.155.129:37409)
0807 19:53:38.377252 (+ 595us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.377260 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.379682 (+ 2422us) server_negotiation.cc:407] Connection header received
0807 19:53:38.379868 (+ 186us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.379876 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.380082 (+ 206us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.380279 (+ 197us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:38.380985 (+ 706us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.382606 (+ 1621us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.385515 (+ 2909us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.386991 (+ 1476us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.387185 (+ 194us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.387408 (+ 223us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.387867 (+ 459us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.388041 (+ 174us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":424,"thread_start_us":289,"threads_started":1}
I20260807 19:53:38.389976 11650 tablet_service.cc:1467] Processing CreateTablet for tablet 8d1b4233de1d4570b0ff0a619b085ac0 (DEFAULT_TABLE table=test-table [id=69f69deec5894c0ca91bfd0b1bb03a7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:38.390050 11864 tablet_service.cc:1467] Processing CreateTablet for tablet 8d1b4233de1d4570b0ff0a619b085ac0 (DEFAULT_TABLE table=test-table [id=69f69deec5894c0ca91bfd0b1bb03a7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:38.391307 11650 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d1b4233de1d4570b0ff0a619b085ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:38.391571 11864 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d1b4233de1d4570b0ff0a619b085ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:38.391865 11443 tablet_service.cc:1467] Processing CreateTablet for tablet 8d1b4233de1d4570b0ff0a619b085ac0 (DEFAULT_TABLE table=test-table [id=69f69deec5894c0ca91bfd0b1bb03a7d]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:38.393213 11443 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 8d1b4233de1d4570b0ff0a619b085ac0. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:38.394544 11549 heartbeater.cc:503] Master 127.12.155.190:41497 was elected leader, sending a full tablet report...
I20260807 19:53:38.403868 11989 tablet_bootstrap.cc:492] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Bootstrap starting.
I20260807 19:53:38.407757 11992 tablet_bootstrap.cc:492] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Bootstrap starting.
I20260807 19:53:38.408188 11989 tablet_bootstrap.cc:654] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:38.408643 11991 tablet_bootstrap.cc:492] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Bootstrap starting.
I20260807 19:53:38.409647 11989 log.cc:824] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:38.411957 11992 tablet_bootstrap.cc:654] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:38.412112 11991 tablet_bootstrap.cc:654] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:38.413009 11992 log.cc:824] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:38.413050 11989 tablet_bootstrap.cc:492] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: No bootstrap required, opened a new log
I20260807 19:53:38.413305 11991 log.cc:824] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:38.413357 11989 ts_tablet_manager.cc:1397] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Time spent bootstrapping tablet: real 0.010s user 0.006s sys 0.000s
I20260807 19:53:38.417137 11992 tablet_bootstrap.cc:492] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: No bootstrap required, opened a new log
I20260807 19:53:38.417479 11992 ts_tablet_manager.cc:1397] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Time spent bootstrapping tablet: real 0.010s user 0.008s sys 0.000s
I20260807 19:53:38.417870 11991 tablet_bootstrap.cc:492] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: No bootstrap required, opened a new log
I20260807 19:53:38.418187 11991 ts_tablet_manager.cc:1397] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Time spent bootstrapping tablet: real 0.010s user 0.002s sys 0.006s
I20260807 19:53:38.421837 11989 raft_consensus.cc:348] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.422268 11989 raft_consensus.cc:374] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:38.422379 11989 raft_consensus.cc:729] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9d0cf9d0aaf443bf923c757032e7c2ca, State: Initialized, Role: FOLLOWER
I20260807 19:53:38.423022 11989 consensus_queue.cc:260] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.424118 11757 heartbeater.cc:503] Master 127.12.155.190:41497 was elected leader, sending a full tablet report...
I20260807 19:53:38.424827 11989 ts_tablet_manager.cc:1428] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Time spent starting tablet: real 0.011s user 0.013s sys 0.000s
I20260807 19:53:38.428424 11992 raft_consensus.cc:348] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.428930 11992 raft_consensus.cc:374] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:38.428769 11991 raft_consensus.cc:348] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.429062 11992 raft_consensus.cc:729] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: cff8225600884bbe9689aafb7010be82, State: Initialized, Role: FOLLOWER
I20260807 19:53:38.429220 11991 raft_consensus.cc:374] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:38.429327 11991 raft_consensus.cc:729] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 060cb66f8d494c5a86b555f44ff82fac, State: Initialized, Role: FOLLOWER
I20260807 19:53:38.429770 11992 consensus_queue.cc:260] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.429869 11991 consensus_queue.cc:260] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.431015 11960 heartbeater.cc:503] Master 127.12.155.190:41497 was elected leader, sending a full tablet report...
I20260807 19:53:38.431671 11992 ts_tablet_manager.cc:1428] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 19:53:38.431671 11991 ts_tablet_manager.cc:1428] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Time spent starting tablet: real 0.013s user 0.010s sys 0.002s
W20260807 19:53:38.570263 11961 tablet.cc:2369] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:38.584024 11758 tablet.cc:2369] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:38.618886 11551 tablet.cc:2369] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:38.662926 12003 raft_consensus.cc:482] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:38.663287 12003 raft_consensus.cc:504] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.665132 12003 leader_election.cc:288] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers cff8225600884bbe9689aafb7010be82 (127.12.155.131:38707), 9d0cf9d0aaf443bf923c757032e7c2ca (127.12.155.130:44239)
I20260807 19:53:38.674096 11986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.666624 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:51015 (local address 127.12.155.130:44239)
0807 19:53:38.666860 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.666867 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.667185 (+ 318us) server_negotiation.cc:407] Connection header received
0807 19:53:38.667426 (+ 241us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.667431 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.667505 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.667678 (+ 173us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:38.668206 (+ 528us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.669114 (+ 908us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.671900 (+ 2786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.672938 (+ 1038us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.673136 (+ 198us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.673214 (+ 78us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.673631 (+ 417us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.673793 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":82}
I20260807 19:53:38.674278 12011 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.666350 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:44239 (local address 127.12.155.129:51015)
0807 19:53:38.667053 (+ 703us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.667076 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:38.667241 (+ 165us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:38.667702 (+ 461us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:38.667706 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:38.667729 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:38.668049 (+ 320us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.668057 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.669255 (+ 1198us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.669263 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.671712 (+ 2449us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.671725 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.673166 (+ 1441us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.673173 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.673417 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.673456 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:53:38.673576 (+ 120us) client_negotiation.cc:240] Negotiation successful
0807 19:53:38.673733 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":573,"mutex_wait_us":3,"thread_start_us":365,"threads_started":1}
I20260807 19:53:38.674170 11983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.665564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:40235 (local address 127.12.155.131:38707)
0807 19:53:38.665855 (+ 291us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.665865 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.666354 (+ 489us) server_negotiation.cc:407] Connection header received
0807 19:53:38.666608 (+ 254us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.666617 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.666738 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.666853 (+ 115us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:38.667661 (+ 808us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.668742 (+ 1081us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.671847 (+ 3105us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.673052 (+ 1205us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.673226 (+ 174us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.673306 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.673794 (+ 488us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.673925 (+ 131us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:53:38.674301 12005 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.665475 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:38707 (local address 127.12.155.129:40235)
0807 19:53:38.666194 (+ 719us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.666213 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:38.666414 (+ 201us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:38.666969 (+ 555us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:38.666975 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:38.667006 (+ 31us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:38.667490 (+ 484us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.667501 (+ 11us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.668884 (+ 1383us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.668888 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.671489 (+ 2601us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:38.671506 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.673363 (+ 1857us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.673370 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:38.673581 (+ 211us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.673613 (+ 32us) client_negotiation.cc:769] Sending connection context
0807 19:53:38.673700 (+ 87us) client_negotiation.cc:240] Negotiation successful
0807 19:53:38.673804 (+ 104us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":531,"mutex_wait_us":78,"spinlock_wait_cycles":23296,"thread_start_us":370,"threads_started":1}
I20260807 19:53:38.675691 11898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d1b4233de1d4570b0ff0a619b085ac0" candidate_uuid: "060cb66f8d494c5a86b555f44ff82fac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff8225600884bbe9689aafb7010be82" is_pre_election: true
I20260807 19:53:38.675696 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d1b4233de1d4570b0ff0a619b085ac0" candidate_uuid: "060cb66f8d494c5a86b555f44ff82fac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" is_pre_election: true
I20260807 19:53:38.676328 11898 raft_consensus.cc:2454] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 060cb66f8d494c5a86b555f44ff82fac in term 0.
I20260807 19:53:38.676328 11684 raft_consensus.cc:2454] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 060cb66f8d494c5a86b555f44ff82fac in term 0.
I20260807 19:53:38.677002 11356 leader_election.cc:302] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 060cb66f8d494c5a86b555f44ff82fac, cff8225600884bbe9689aafb7010be82; no voters:
I20260807 19:53:38.677376 12003 raft_consensus.cc:2781] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:53:38.677610 12003 raft_consensus.cc:482] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:53:38.677758 12003 raft_consensus.cc:3037] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:38.680194 12003 raft_consensus.cc:504] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.680822 12003 leader_election.cc:288] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [CANDIDATE]: Term 1 election: Requested vote from peers cff8225600884bbe9689aafb7010be82 (127.12.155.131:38707), 9d0cf9d0aaf443bf923c757032e7c2ca (127.12.155.130:44239)
I20260807 19:53:38.681373 11898 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d1b4233de1d4570b0ff0a619b085ac0" candidate_uuid: "060cb66f8d494c5a86b555f44ff82fac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "cff8225600884bbe9689aafb7010be82"
I20260807 19:53:38.681463 11684 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8d1b4233de1d4570b0ff0a619b085ac0" candidate_uuid: "060cb66f8d494c5a86b555f44ff82fac" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca"
I20260807 19:53:38.681667 11684 raft_consensus.cc:3037] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:38.681674 11898 raft_consensus.cc:3037] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:38.685317 11898 raft_consensus.cc:2454] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 060cb66f8d494c5a86b555f44ff82fac in term 1.
I20260807 19:53:38.685317 11684 raft_consensus.cc:2454] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 060cb66f8d494c5a86b555f44ff82fac in term 1.
I20260807 19:53:38.685784 11356 leader_election.cc:302] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 060cb66f8d494c5a86b555f44ff82fac, cff8225600884bbe9689aafb7010be82; no voters:
I20260807 19:53:38.686138 12003 raft_consensus.cc:2781] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:38.686610 12003 raft_consensus.cc:686] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 1 LEADER]: Becoming Leader. State: Replica: 060cb66f8d494c5a86b555f44ff82fac, State: Running, Role: LEADER
I20260807 19:53:38.687101 12003 consensus_queue.cc:237] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } }
I20260807 19:53:38.691612 11234 catalog_manager.cc:5495] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac reported cstate change: term changed from 0 to 1, leader changed from <none> to 060cb66f8d494c5a86b555f44ff82fac (127.12.155.129). New cstate: current_term: 1 leader_uuid: "060cb66f8d494c5a86b555f44ff82fac" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "060cb66f8d494c5a86b555f44ff82fac" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37409 } health_report { overall_health: HEALTHY } } }
I20260807 19:53:38.757251 11988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.751602 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49016 (local address 127.12.155.129:37409)
0807 19:53:38.751837 (+ 235us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.751842 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.751862 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:53:38.752066 (+ 204us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.752073 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.752192 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.752324 (+ 132us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:53:38.752792 (+ 468us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.753593 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.755008 (+ 1415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.755437 (+ 429us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.755537 (+ 100us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.756054 (+ 517us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:53:38.756553 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:53:38.756751 (+ 198us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.756907 (+ 156us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.756970 (+ 63us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:53:38.765949 11898 raft_consensus.cc:1261] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 1 FOLLOWER]: Refusing update from remote peer 060cb66f8d494c5a86b555f44ff82fac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:38.766165 11684 raft_consensus.cc:1261] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 1 FOLLOWER]: Refusing update from remote peer 060cb66f8d494c5a86b555f44ff82fac: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:38.766963 12003 consensus_queue.cc:1035] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [LEADER]: Connected to new peer: Peer: permanent_uuid: "cff8225600884bbe9689aafb7010be82" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 38707 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:38.767323 12012 consensus_queue.cc:1035] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [LEADER]: Connected to new peer: Peer: permanent_uuid: "9d0cf9d0aaf443bf923c757032e7c2ca" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 44239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:38.779863 12017 mvcc.cc:205] Tried to move back new op lower bound from 7315998387254812672 to 7315998386945802240. Current Snapshot: MvccSnapshot[applied={T|T < 7315998387254812672}]
I20260807 19:53:38.782914 12016 mvcc.cc:205] Tried to move back new op lower bound from 7315998387254812672 to 7315998386945802240. Current Snapshot: MvccSnapshot[applied={T|T < 7315998387254812672}]
I20260807 19:53:38.795336 12018 mvcc.cc:205] Tried to move back new op lower bound from 7315998387254812672 to 7315998386945802240. Current Snapshot: MvccSnapshot[applied={T|T < 7315998387254812672}]
I20260807 19:53:38.802690 11234 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:47618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:38.802995 11234 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:47618:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:38.806936 11234 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9e357bb5b5324621b4c458a33d46f871: Sending DeleteTablet for 3 replicas of tablet 8d1b4233de1d4570b0ff0a619b085ac0
I20260807 19:53:38.808094 11864 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d1b4233de1d4570b0ff0a619b085ac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:38 UTC) from {username='slave'} at 127.0.0.1:38318
I20260807 19:53:38.808401 11650 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d1b4233de1d4570b0ff0a619b085ac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:38 UTC) from {username='slave'} at 127.0.0.1:52586
I20260807 19:53:38.809180 11443 tablet_service.cc:1514] Processing DeleteTablet for tablet 8d1b4233de1d4570b0ff0a619b085ac0 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:38 UTC) from {username='slave'} at 127.0.0.1:49002
I20260807 19:53:38.811316 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 11328
I20260807 19:53:38.822541 12034 tablet_replica.cc:330] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: stopping tablet replica
I20260807 19:53:38.824524 12033 tablet_replica.cc:330] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: stopping tablet replica
I20260807 19:53:38.824728 12034 raft_consensus.cc:2229] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:53:38.825452 12034 raft_consensus.cc:2258] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:38.826025 12033 raft_consensus.cc:2229] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:38.826283 12032 tablet_replica.cc:330] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: stopping tablet replica
I20260807 19:53:38.826668 12032 raft_consensus.cc:2229] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:38.826840 12033 raft_consensus.cc:2258] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:38.827157 12032 raft_consensus.cc:2258] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:38.829797 12034 ts_tablet_manager.cc:1905] T 8d1b4233de1d4570b0ff0a619b085ac0 P 060cb66f8d494c5a86b555f44ff82fac: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:38.830047 12032 ts_tablet_manager.cc:1905] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:38.834748 11988 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.814575 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:49024 (local address 127.12.155.129:37409)
0807 19:53:38.814809 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.814819 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.819117 (+ 4298us) server_negotiation.cc:407] Connection header received
0807 19:53:38.820252 (+ 1135us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.820261 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.820426 (+ 165us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.820532 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:38.822968 (+ 2436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.824494 (+ 1526us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.826670 (+ 2176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.827391 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.827502 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.832670 (+ 5168us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:38.832684 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:38.832700 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:38.833485 (+ 785us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:38.833550 (+ 65us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:38.833574 (+ 24us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:38.833681 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.834237 (+ 556us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.834352 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 19:53:38.836202 11533 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:38.829620 12033 ts_tablet_manager.cc:1905] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:38.840924 12032 ts_tablet_manager.cc:1918] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:38.841629 12032 log.cc:1196] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/8d1b4233de1d4570b0ff0a619b085ac0
I20260807 19:53:38.842403 12032 ts_tablet_manager.cc:1939] T 8d1b4233de1d4570b0ff0a619b085ac0 P cff8225600884bbe9689aafb7010be82: Deleting consensus metadata
I20260807 19:53:38.844404 11214 catalog_manager.cc:4841] TS cff8225600884bbe9689aafb7010be82 (127.12.155.131:38707): tablet 8d1b4233de1d4570b0ff0a619b085ac0 (table test-table [id=69f69deec5894c0ca91bfd0b1bb03a7d]) successfully deleted
I20260807 19:53:38.846457 12033 ts_tablet_manager.cc:1918] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:38.846750 12033 log.cc:1196] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_3.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/8d1b4233de1d4570b0ff0a619b085ac0
I20260807 19:53:38.847394 12033 ts_tablet_manager.cc:1939] T 8d1b4233de1d4570b0ff0a619b085ac0 P 9d0cf9d0aaf443bf923c757032e7c2ca: Deleting consensus metadata
I20260807 19:53:38.849179 11214 catalog_manager.cc:4841] TS 9d0cf9d0aaf443bf923c757032e7c2ca (127.12.155.130:44239): tablet 8d1b4233de1d4570b0ff0a619b085ac0 (table test-table [id=69f69deec5894c0ca91bfd0b1bb03a7d]) successfully deleted
I20260807 19:53:38.946043 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 11328
W20260807 19:53:38.971573 11214 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:37409 (error 108)
I20260807 19:53:38.972368 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 11557
I20260807 19:53:38.973749 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.972891 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49026)
0807 19:53:38.973383 (+ 492us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:38.973534 (+ 151us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":359,"thread_start_us":271,"threads_started":1}
W20260807 19:53:38.974026 11214 catalog_manager.cc:4584] TS 060cb66f8d494c5a86b555f44ff82fac (127.12.155.129:37409): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 8d1b4233de1d4570b0ff0a619b085ac0: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
I20260807 19:53:38.979547 11986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:38.973203 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52588 (local address 127.12.155.130:44239)
0807 19:53:38.973395 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:38.973400 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:38.973479 (+ 79us) server_negotiation.cc:407] Connection header received
0807 19:53:38.973701 (+ 222us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:38.973706 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:38.973787 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:38.973899 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:38.974406 (+ 507us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.975125 (+ 719us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.976479 (+ 1354us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:38.976906 (+ 427us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:38.977041 (+ 135us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:38.978179 (+ 1138us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:38.978188 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:38.978201 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:38.978792 (+ 591us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:38.978837 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:38.978858 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:38.978985 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:38.979126 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 19:53:38.979234 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":81}
I20260807 19:53:38.980188 11749 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:39.027724 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.027161 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49040)
0807 19:53:39.027404 (+ 243us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:39.027527 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":82}
I20260807 19:53:39.028875 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.028418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49046)
0807 19:53:39.028609 (+ 191us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:39.028696 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 19:53:39.073311 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 11557
I20260807 19:53:39.089494 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.088862 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49056)
0807 19:53:39.089143 (+ 281us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:39.089267 (+ 124us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":95}
I20260807 19:53:39.090727 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.090234 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49068)
0807 19:53:39.090422 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:39.090525 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
I20260807 19:53:39.100157 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 11760
I20260807 19:53:39.107788 11983 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.100981 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:38326 (local address 127.12.155.131:38707)
0807 19:53:39.101182 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:39.101190 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:39.101285 (+ 95us) server_negotiation.cc:407] Connection header received
0807 19:53:39.101525 (+ 240us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:39.101533 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:39.101659 (+ 126us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:39.101778 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:39.102304 (+ 526us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:39.103367 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:39.104734 (+ 1367us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:39.105146 (+ 412us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:39.105262 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:39.106444 (+ 1182us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:39.106454 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:39.106469 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:39.107073 (+ 604us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:39.107125 (+ 52us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:39.107169 (+ 44us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:39.107260 (+ 91us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:39.107399 (+ 139us) server_negotiation.cc:299] Negotiation successful
0807 19:53:39.107488 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:53:39.108448 11948 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:39.171357 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.170837 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49072)
0807 19:53:39.171095 (+ 258us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:39.171210 (+ 115us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":92}
I20260807 19:53:39.172499 12039 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:39.172089 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37409 (local address 127.0.0.1:49084)
0807 19:53:39.172295 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:39.172364 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37409: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":97}
I20260807 19:53:39.196705 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 11760
I20260807 19:53:39.222342 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 11191
I20260807 19:53:39.223567 11290 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:39.332482 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 11191
2026-08-07T19:53:39Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/3 (3114 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/4
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:39 dist-test-slave-2p8l krb5kdc[12056](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:39 dist-test-slave-2p8l krb5kdc[12056](info): set up 2 sockets
Aug 07 19:53:39 dist-test-slave-2p8l krb5kdc[12056](info): commencing operation
krb5kdc: starting...
W20260807 19:53:40.694497 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.309s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:40 dist-test-slave-2p8l krb5kdc[12056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:40Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:40Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:53:41.015271 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36321
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:36321
--encrypt_data_at_rest=true
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:41.376044 12076 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:41.376327 12076 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:41.376420 12076 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:41.383694 12076 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:41.383812 12076 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:41.383860 12076 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:41.383919 12076 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:41.383965 12076 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:41.393884 12076 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:36321
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:36321
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:41.395196 12076 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:41.396462 12076 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:41.408789 12084 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:41.408756 12085 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:41.408702 12088 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:41.409610 12076 server_base.cc:1034] running on GCE node
I20260807 19:53:41.410483 12076 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:41.411983 12076 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:41.413221 12076 hybrid_clock.cc:648] HybridClock initialized: now 1786132421413161 us; error 45 us; skew 500 ppm
I20260807 19:53:41.413705 12076 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:41 dist-test-slave-2p8l krb5kdc[12056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132421, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:41.417142 12076 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:53:41.418712 12076 webserver.cc:460] Webserver started at http://127.12.155.190:42677/ using document root <none> and password file <none>
I20260807 19:53:41.419404 12076 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:41.419580 12076 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:41.419904 12076 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:41.423008 12076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "9be88127adc04435a73646fbddcd5a2c"
format_stamp: "Formatted at 2026-08-07 19:53:41 on dist-test-slave-2p8l"
server_key: "c9b7de3073b46fdf7fd8d72a9a39fad4"
server_key_iv: "55fa071c031292af608f0b3d1e3e9ddf"
server_key_version: "encryptionkey@0"
I20260807 19:53:41.423782 12076 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "9be88127adc04435a73646fbddcd5a2c"
format_stamp: "Formatted at 2026-08-07 19:53:41 on dist-test-slave-2p8l"
server_key: "c9b7de3073b46fdf7fd8d72a9a39fad4"
server_key_iv: "55fa071c031292af608f0b3d1e3e9ddf"
server_key_version: "encryptionkey@0"
I20260807 19:53:41.429128 12076 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:53:41.432541 12099 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:41.433833 12076 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:53:41.434016 12076 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "9be88127adc04435a73646fbddcd5a2c"
format_stamp: "Formatted at 2026-08-07 19:53:41 on dist-test-slave-2p8l"
server_key: "c9b7de3073b46fdf7fd8d72a9a39fad4"
server_key_iv: "55fa071c031292af608f0b3d1e3e9ddf"
server_key_version: "encryptionkey@0"
I20260807 19:53:41.434257 12076 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:41.445626 12076 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:41.450122 12076 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:41.450420 12076 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:41.469636 12076 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:36321
I20260807 19:53:41.469673 12186 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:36321 every 8 connection(s)
I20260807 19:53:41.471078 12076 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:41.474910 12189 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:41.476625 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 12076
I20260807 19:53:41.476817 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:41.477286 12910 external_mini_cluster.cc:1428] Setting key e39df41a599e45f555f2fd00b013d0fe
I20260807 19:53:41.489296 12189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c: Bootstrap starting.
Aug 07 19:53:41 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:41.492571 12189 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:41.493741 12189 log.cc:824] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:41.497376 12189 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c: No bootstrap required, opened a new log
I20260807 19:53:41.502424 12193 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:41.479236 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57960 (local address 127.12.155.190:36321)
0807 19:53:41.480108 (+ 872us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:41.480123 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:41.480183 (+ 60us) server_negotiation.cc:407] Connection header received
0807 19:53:41.481902 (+ 1719us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:41.481929 (+ 27us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:41.482448 (+ 519us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:41.482874 (+ 426us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:41.484260 (+ 1386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:41.486446 (+ 2186us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:41.487867 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:41.488881 (+ 1014us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:41.489058 (+ 177us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:41.493494 (+ 4436us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:41.493507 (+ 13us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:41.493532 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:41.493589 (+ 57us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:41.497573 (+ 3984us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:41.498433 (+ 860us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:41.498441 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:41.498449 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:41.498671 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:41.499102 (+ 431us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:41.499107 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:41.499111 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:41.499837 (+ 726us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:41.500139 (+ 302us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:41.500537 (+ 398us) server_negotiation.cc:299] Negotiation successful
0807 19:53:41.501001 (+ 464us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":585,"thread_start_us":343,"threads_started":1}
I20260807 19:53:41.507210 12189 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9be88127adc04435a73646fbddcd5a2c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36321 } }
I20260807 19:53:41.507702 12189 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:41.507824 12189 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9be88127adc04435a73646fbddcd5a2c, State: Initialized, Role: FOLLOWER
I20260807 19:53:41.508482 12189 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9be88127adc04435a73646fbddcd5a2c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36321 } }
I20260807 19:53:41.508781 12189 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:41.508940 12189 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:41.509127 12189 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:41.511389 12189 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9be88127adc04435a73646fbddcd5a2c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36321 } }
I20260807 19:53:41.511860 12189 leader_election.cc:302] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9be88127adc04435a73646fbddcd5a2c; no voters:
I20260807 19:53:41.512460 12189 leader_election.cc:288] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:41.512578 12195 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:41.514187 12195 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [term 1 LEADER]: Becoming Leader. State: Replica: 9be88127adc04435a73646fbddcd5a2c, State: Running, Role: LEADER
I20260807 19:53:41.514744 12189 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:41.514698 12195 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9be88127adc04435a73646fbddcd5a2c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36321 } }
I20260807 19:53:41.517591 12197 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9be88127adc04435a73646fbddcd5a2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9be88127adc04435a73646fbddcd5a2c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36321 } } }
I20260807 19:53:41.517589 12199 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9be88127adc04435a73646fbddcd5a2c. Latest consensus state: current_term: 1 leader_uuid: "9be88127adc04435a73646fbddcd5a2c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9be88127adc04435a73646fbddcd5a2c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 36321 } } }
I20260807 19:53:41.518042 12197 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:41.518149 12199 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:41.519073 12211 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:41.525688 12211 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:41.534405 12211 catalog_manager.cc:1347] Generated new cluster ID: 146793a87c744850919a697631c0857a
I20260807 19:53:41.534521 12211 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:41.559689 12211 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:41.560974 12211 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:41.570785 12211 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c: Generated new TSK 0
I20260807 19:53:41.571808 12211 catalog_manager.cc:1514] Initializing in-progress tserver states...
WARNING: no policy specified for kudu/127.12.155.129@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.129@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
Entry for principal kudu/127.12.155.129 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab.
I20260807 19:53:41.648964 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36321
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:41.998430 12229 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:41.998762 12229 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:41.998934 12229 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:42.006222 12229 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:42.006376 12229 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:42.006553 12229 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:42.016288 12229 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.129.keytab
--principal=kudu/127.12.155.129
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:42.017613 12229 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:42.019057 12229 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:42.033200 12243 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:42.033178 12246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:42.033382 12240 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:42.033984 12229 server_base.cc:1034] running on GCE node
I20260807 19:53:42.034652 12229 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:42.035696 12229 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:42.036923 12229 hybrid_clock.cc:648] HybridClock initialized: now 1786132422036860 us; error 56 us; skew 500 ppm
I20260807 19:53:42.037211 12229 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:42 dist-test-slave-2p8l krb5kdc[12056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132422, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:42.040777 12229 init.cc:377] Logged in from keytab as kudu/127.12.155.129@KRBTEST.COM (short username kudu)
I20260807 19:53:42.042316 12229 webserver.cc:460] Webserver started at http://127.12.155.129:45723/ using document root <none> and password file <none>
I20260807 19:53:42.043023 12229 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:42.043161 12229 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:42.043497 12229 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:42.046561 12229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "4a05134cacea49f59143315787ac2e98"
format_stamp: "Formatted at 2026-08-07 19:53:42 on dist-test-slave-2p8l"
server_key: "adc21da79b4bf2add0186252f04c0c69"
server_key_iv: "854be8a2189fc313747e46f7e1a11fe1"
server_key_version: "encryptionkey@0"
I20260807 19:53:42.047397 12229 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "4a05134cacea49f59143315787ac2e98"
format_stamp: "Formatted at 2026-08-07 19:53:42 on dist-test-slave-2p8l"
server_key: "adc21da79b4bf2add0186252f04c0c69"
server_key_iv: "854be8a2189fc313747e46f7e1a11fe1"
server_key_version: "encryptionkey@0"
I20260807 19:53:42.052824 12229 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:53:42.056742 12256 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:42.058243 12229 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 19:53:42.058437 12229 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "4a05134cacea49f59143315787ac2e98"
format_stamp: "Formatted at 2026-08-07 19:53:42 on dist-test-slave-2p8l"
server_key: "adc21da79b4bf2add0186252f04c0c69"
server_key_iv: "854be8a2189fc313747e46f7e1a11fe1"
server_key_version: "encryptionkey@0"
I20260807 19:53:42.058696 12229 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:42.072853 12229 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:42.077188 12229 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:42.077507 12229 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:42.078600 12229 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:42.080053 12229 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:42.080160 12229 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:42.080315 12229 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:42.080394 12229 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:42.117183 12229 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:37557
I20260807 19:53:42.117249 12460 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:37557 every 8 connection(s)
I20260807 19:53:42.118590 12229 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:42.120571 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 12229
I20260807 19:53:42.120775 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:53:42.121417 12910 external_mini_cluster.cc:1428] Setting key 87e8378db161d887fa324878da662643
Aug 07 19:53:42 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132422, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.129@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:42.143008 12465 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:42.121382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:53585 (local address 127.12.155.190:36321)
0807 19:53:42.122040 (+ 658us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:42.122044 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:42.123034 (+ 990us) server_negotiation.cc:407] Connection header received
0807 19:53:42.125695 (+ 2661us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:42.125699 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:42.125760 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:42.125853 (+ 93us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:42.128255 (+ 2402us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.128984 (+ 729us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.131604 (+ 2620us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.132014 (+ 410us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.132123 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:42.136510 (+ 4387us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:42.136515 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:42.136518 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:42.136556 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:42.139432 (+ 2876us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:42.140474 (+ 1042us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:42.140478 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:42.140481 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:42.140619 (+ 138us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:42.141153 (+ 534us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:42.141156 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:42.141158 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:42.141418 (+ 260us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:42.141533 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:42.142509 (+ 976us) server_negotiation.cc:299] Negotiation successful
0807 19:53:42.142749 (+ 240us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":541,"thread_start_us":359,"threads_started":1}
I20260807 19:53:42.144558 12466 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:42.121986 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36321 (local address 127.12.155.129:53585)
0807 19:53:42.122870 (+ 884us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:42.122917 (+ 47us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:42.125395 (+ 2478us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:42.126193 (+ 798us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:42.126207 (+ 14us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:42.127074 (+ 867us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:42.128055 (+ 981us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:42.128085 (+ 30us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.129152 (+ 1067us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.129160 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:42.131405 (+ 2245us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:42.131424 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.132263 (+ 839us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.132273 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:42.132611 (+ 338us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:42.133390 (+ 779us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:42.133424 (+ 34us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:42.136280 (+ 2856us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:42.139613 (+ 3333us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:42.139625 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:42.139645 (+ 20us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:42.140316 (+ 671us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:42.140738 (+ 422us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:42.140745 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:42.140751 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:42.141020 (+ 269us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:42.141558 (+ 538us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:42.141569 (+ 11us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:42.142027 (+ 458us) client_negotiation.cc:769] Sending connection context
0807 19:53:42.142392 (+ 365us) client_negotiation.cc:240] Negotiation successful
0807 19:53:42.142985 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":629,"thread_start_us":377,"threads_started":1}
I20260807 19:53:42.146296 12463 heartbeater.cc:347] Connected to a master server at 127.12.155.190:36321
I20260807 19:53:42.146653 12463 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:42.147393 12463 heartbeater.cc:511] Master 127.12.155.190:36321 requested a full tablet report, sending...
I20260807 19:53:42.149585 12127 ts_manager.cc:194] Registered new tserver with Master: 4a05134cacea49f59143315787ac2e98 (127.12.155.129:37557)
I20260807 19:53:42.151170 12127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.129@KRBTEST.COM'} at 127.12.155.129:53585
WARNING: no policy specified for kudu/127.12.155.130@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.130@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
Entry for principal kudu/127.12.155.130 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab.
I20260807 19:53:42.193493 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36321
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:42.530910 12470 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:42.531193 12470 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:42.531419 12470 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:42.538651 12470 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:42.538774 12470 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:42.538959 12470 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:42.548450 12470 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.130.keytab
--principal=kudu/127.12.155.130
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:42.549737 12470 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:42.551085 12470 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:42.564767 12479 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:42.564787 12483 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:42.564827 12481 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:42.565768 12470 server_base.cc:1034] running on GCE node
I20260807 19:53:42.566448 12470 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:42.567373 12470 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:42.568609 12470 hybrid_clock.cc:648] HybridClock initialized: now 1786132422568557 us; error 60 us; skew 500 ppm
I20260807 19:53:42.568933 12470 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:42 dist-test-slave-2p8l krb5kdc[12056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132422, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:42.572124 12470 init.cc:377] Logged in from keytab as kudu/127.12.155.130@KRBTEST.COM (short username kudu)
I20260807 19:53:42.573534 12470 webserver.cc:460] Webserver started at http://127.12.155.130:46813/ using document root <none> and password file <none>
I20260807 19:53:42.574327 12470 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:42.574482 12470 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:42.574815 12470 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:42.577699 12470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "efcd6f77b3c9400486cb69bf5e32fddc"
format_stamp: "Formatted at 2026-08-07 19:53:42 on dist-test-slave-2p8l"
server_key: "50155e8aaee61caee479d7b703cb02f7"
server_key_iv: "3c6ed0153dfe8314304e86cbf7333219"
server_key_version: "encryptionkey@0"
I20260807 19:53:42.578503 12470 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "efcd6f77b3c9400486cb69bf5e32fddc"
format_stamp: "Formatted at 2026-08-07 19:53:42 on dist-test-slave-2p8l"
server_key: "50155e8aaee61caee479d7b703cb02f7"
server_key_iv: "3c6ed0153dfe8314304e86cbf7333219"
server_key_version: "encryptionkey@0"
I20260807 19:53:42.583559 12470 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:53:42.587086 12495 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:42.588348 12470 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 19:53:42.588538 12470 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "efcd6f77b3c9400486cb69bf5e32fddc"
format_stamp: "Formatted at 2026-08-07 19:53:42 on dist-test-slave-2p8l"
server_key: "50155e8aaee61caee479d7b703cb02f7"
server_key_iv: "3c6ed0153dfe8314304e86cbf7333219"
server_key_version: "encryptionkey@0"
I20260807 19:53:42.588753 12470 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:42.628846 12470 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:42.633464 12470 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:42.633828 12470 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:42.634938 12470 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:42.636405 12470 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:42.636536 12470 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:42.636708 12470 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:42.636790 12470 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:42.674122 12470 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:42737
I20260807 19:53:42.674191 12669 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:42737 every 8 connection(s)
I20260807 19:53:42.675555 12470 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:42.683907 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 12470
I20260807 19:53:42.684083 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:53:42.684551 12910 external_mini_cluster.cc:1428] Setting key 7a3f74a084cc3684ce53fd9d29e128dd
Aug 07 19:53:42 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132422, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.130@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:42.698005 12675 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:42.678376 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:41115 (local address 127.12.155.190:36321)
0807 19:53:42.679301 (+ 925us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:42.679307 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:42.680066 (+ 759us) server_negotiation.cc:407] Connection header received
0807 19:53:42.682140 (+ 2074us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:42.682149 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:42.682247 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:42.682388 (+ 141us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:42.683951 (+ 1563us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.684931 (+ 980us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.686938 (+ 2007us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.687396 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.687552 (+ 156us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:42.691613 (+ 4061us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:42.691618 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:42.691622 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:42.691654 (+ 32us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:42.694678 (+ 3024us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:42.695610 (+ 932us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:42.695614 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:42.695616 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:42.695739 (+ 123us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:42.696277 (+ 538us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:42.696280 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:42.696282 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:42.696557 (+ 275us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:42.696674 (+ 117us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:42.697574 (+ 900us) server_negotiation.cc:299] Negotiation successful
0807 19:53:42.697737 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":812,"thread_start_us":709,"threads_started":1}
I20260807 19:53:42.699512 12679 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:42.679119 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36321 (local address 127.12.155.130:41115)
0807 19:53:42.679882 (+ 763us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:42.679925 (+ 43us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:42.681817 (+ 1892us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:42.682633 (+ 816us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:42.682642 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:42.683198 (+ 556us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:42.683770 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:42.683788 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.685108 (+ 1320us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.685113 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:42.686776 (+ 1663us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:42.686789 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:42.687649 (+ 860us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:42.687657 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:42.687894 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:42.688655 (+ 761us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:42.688677 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:42.691357 (+ 2680us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:42.694821 (+ 3464us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:42.694833 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:42.694854 (+ 21us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:42.695487 (+ 633us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:42.695883 (+ 396us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:42.695890 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:42.695897 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:42.696156 (+ 259us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:42.696700 (+ 544us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:42.696712 (+ 12us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:42.697167 (+ 455us) client_negotiation.cc:769] Sending connection context
0807 19:53:42.697485 (+ 318us) client_negotiation.cc:240] Negotiation successful
0807 19:53:42.698045 (+ 560us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":515,"thread_start_us":283,"threads_started":1}
I20260807 19:53:42.700930 12670 heartbeater.cc:347] Connected to a master server at 127.12.155.190:36321
I20260807 19:53:42.701283 12670 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:42.702184 12670 heartbeater.cc:511] Master 127.12.155.190:36321 requested a full tablet report, sending...
I20260807 19:53:42.703819 12127 ts_manager.cc:194] Registered new tserver with Master: efcd6f77b3c9400486cb69bf5e32fddc (127.12.155.130:42737)
I20260807 19:53:42.704658 12127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.130@KRBTEST.COM'} at 127.12.155.130:41115
WARNING: no policy specified for kudu/127.12.155.131@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.131@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
Entry for principal kudu/127.12.155.131 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab.
I20260807 19:53:42.753662 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36321
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:39343
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:43.099994 12683 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:43.100270 12683 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:43.100430 12683 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:43.107583 12683 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:43.107685 12683 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:43.107898 12683 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:43.118961 12683 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:39343
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.131.keytab
--principal=kudu/127.12.155.131
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:36321
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:43.120217 12683 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:43.121726 12683 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:43.134859 12691 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:43.135015 12692 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:43.134925 12697 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:43.135881 12683 server_base.cc:1034] running on GCE node
I20260807 19:53:43.136449 12683 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:43.137346 12683 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:43.138584 12683 hybrid_clock.cc:648] HybridClock initialized: now 1786132423138529 us; error 71 us; skew 500 ppm
I20260807 19:53:43.138962 12683 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:43 dist-test-slave-2p8l krb5kdc[12056](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132423, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:43.142354 12683 init.cc:377] Logged in from keytab as kudu/127.12.155.131@KRBTEST.COM (short username kudu)
I20260807 19:53:43.143836 12683 webserver.cc:460] Webserver started at http://127.12.155.131:42435/ using document root <none> and password file <none>
I20260807 19:53:43.144588 12683 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:43.144740 12683 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:43.145066 12683 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:43.148018 12683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "66384d2e8d8a422aabc9b9862961e60f"
format_stamp: "Formatted at 2026-08-07 19:53:43 on dist-test-slave-2p8l"
server_key: "152469f989ab8057a19836a765f8ee60"
server_key_iv: "cc1a7aced6c712074506a203771688e4"
server_key_version: "encryptionkey@0"
I20260807 19:53:43.148801 12683 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "66384d2e8d8a422aabc9b9862961e60f"
format_stamp: "Formatted at 2026-08-07 19:53:43 on dist-test-slave-2p8l"
server_key: "152469f989ab8057a19836a765f8ee60"
server_key_iv: "cc1a7aced6c712074506a203771688e4"
server_key_version: "encryptionkey@0"
I20260807 19:53:43.153841 12683 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 19:53:43.154904 12463 heartbeater.cc:503] Master 127.12.155.190:36321 was elected leader, sending a full tablet report...
I20260807 19:53:43.157621 12710 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:43.158967 12683 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:43.159127 12683 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "66384d2e8d8a422aabc9b9862961e60f"
format_stamp: "Formatted at 2026-08-07 19:53:43 on dist-test-slave-2p8l"
server_key: "152469f989ab8057a19836a765f8ee60"
server_key_iv: "cc1a7aced6c712074506a203771688e4"
server_key_version: "encryptionkey@0"
I20260807 19:53:43.159337 12683 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:43.179147 12683 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:43.183439 12683 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:43.183791 12683 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:43.184854 12683 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:43.186318 12683 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:43.186393 12683 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:43.186561 12683 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:43.186619 12683 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:43.220117 12683 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:43583
I20260807 19:53:43.220225 12885 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:43583 every 8 connection(s)
I20260807 19:53:43.221516 12683 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:43.224787 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 12683
I20260807 19:53:43.224977 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:53:43.225443 12910 external_mini_cluster.cc:1428] Setting key 3f0e43d3a381aa7d8bb21c8d4fd2c44a
Aug 07 19:53:43 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132423, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.131@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:53:43.243367 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.224483 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:58629 (local address 127.12.155.190:36321)
0807 19:53:43.224994 (+ 511us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.225001 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.226234 (+ 1233us) server_negotiation.cc:407] Connection header received
0807 19:53:43.228187 (+ 1953us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.228193 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.228284 (+ 91us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.228372 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:43.229920 (+ 1548us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.230807 (+ 887us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.232416 (+ 1609us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.232812 (+ 396us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.232908 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.236441 (+ 3533us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:43.236447 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:43.236459 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:43.236500 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:43.240164 (+ 3664us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.241197 (+ 1033us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.241202 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.241204 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.241323 (+ 119us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.241777 (+ 454us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.241780 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.241782 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.242044 (+ 262us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:43.242238 (+ 194us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.242916 (+ 678us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.243080 (+ 164us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":363,"thread_start_us":236,"threads_started":1}
I20260807 19:53:43.244309 12892 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.225127 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:36321 (local address 127.12.155.131:58629)
0807 19:53:43.226035 (+ 908us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:43.226113 (+ 78us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:43.227929 (+ 1816us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:43.228617 (+ 688us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:43.228625 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:43.229169 (+ 544us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:43.229763 (+ 594us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.229781 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.230980 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.230984 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.232280 (+ 1296us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.232292 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.233003 (+ 711us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.233007 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.233219 (+ 212us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.233987 (+ 768us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:53:43.234014 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:43.236213 (+ 2199us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:43.240324 (+ 4111us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:43.240332 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:43.240345 (+ 13us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:43.241080 (+ 735us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:43.241424 (+ 344us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:53:43.241427 (+ 3us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:53:43.241430 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:53:43.241675 (+ 245us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:53:43.242237 (+ 562us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:43.242243 (+ 6us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:43.242580 (+ 337us) client_negotiation.cc:769] Sending connection context
0807 19:53:43.242822 (+ 242us) client_negotiation.cc:240] Negotiation successful
0807 19:53:43.243201 (+ 379us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":616,"thread_start_us":390,"threads_started":1}
I20260807 19:53:43.245620 12886 heartbeater.cc:347] Connected to a master server at 127.12.155.190:36321
I20260807 19:53:43.245986 12886 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:43.246788 12886 heartbeater.cc:511] Master 127.12.155.190:36321 requested a full tablet report, sending...
I20260807 19:53:43.248241 12127 ts_manager.cc:194] Registered new tserver with Master: 66384d2e8d8a422aabc9b9862961e60f (127.12.155.131:43583)
I20260807 19:53:43.249051 12127 master_service.cc:496] Signed X509 certificate for tserver {username='kudu', principal='kudu/127.12.155.131@KRBTEST.COM'} at 127.12.155.131:58629
I20260807 19:53:43.253110 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:53:43.270696 12890 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.257234 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57964 (local address 127.12.155.190:36321)
0807 19:53:43.257456 (+ 222us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.257464 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.257803 (+ 339us) server_negotiation.cc:407] Connection header received
0807 19:53:43.258001 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.258005 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.258139 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.258242 (+ 103us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:43.259676 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.260368 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.261669 (+ 1301us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.262200 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.262338 (+ 138us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.265077 (+ 2739us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:43.265082 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:43.265086 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:43.265119 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:43.268191 (+ 3072us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.268805 (+ 614us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.268809 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.268812 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.268933 (+ 121us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.269269 (+ 336us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.269272 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.269274 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.269606 (+ 332us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:43.269795 (+ 189us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.270140 (+ 345us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.270334 (+ 194us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:53:43.274803 12127 catalog_manager.cc:1908] Servicing CreateTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57964:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:53:43.282385 12127 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:53:43.316429 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.295037 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47154 (local address 127.12.155.131:43583)
0807 19:53:43.308321 (+ 13284us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.308331 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.308365 (+ 34us) server_negotiation.cc:407] Connection header received
0807 19:53:43.308454 (+ 89us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.308460 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.308686 (+ 226us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.308867 (+ 181us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:43.309701 (+ 834us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.311410 (+ 1709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.313690 (+ 2280us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.314913 (+ 1223us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.315147 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.315335 (+ 188us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.315848 (+ 513us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.316018 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":13095,"thread_start_us":12932,"threads_started":1}
I20260807 19:53:43.316602 12907 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.294763 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:43583 (local address 127.0.0.1:47154)
0807 19:53:43.306853 (+ 12090us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:43.306902 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:43.307095 (+ 193us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:43.308865 (+ 1770us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:43.308870 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:43.308899 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:43.309471 (+ 572us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.309487 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.311613 (+ 2126us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.311618 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.313498 (+ 1880us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.313516 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.315129 (+ 1613us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.315135 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.315390 (+ 255us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.315449 (+ 59us) client_negotiation.cc:769] Sending connection context
0807 19:53:43.315791 (+ 342us) client_negotiation.cc:240] Negotiation successful
0807 19:53:43.316019 (+ 228us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":11845,"mutex_wait_us":50,"thread_start_us":12592,"threads_started":1}
I20260807 19:53:43.317298 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.295138 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37294 (local address 127.12.155.130:42737)
0807 19:53:43.305999 (+ 10861us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.306012 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.307684 (+ 1672us) server_negotiation.cc:407] Connection header received
0807 19:53:43.307900 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.307911 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.308211 (+ 300us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.308416 (+ 205us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:43.309352 (+ 936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.311021 (+ 1669us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.313767 (+ 2746us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.315278 (+ 1511us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.315442 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.315602 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.316799 (+ 1197us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.316967 (+ 168us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":10614,"thread_start_us":10897,"threads_started":1}
I20260807 19:53:43.316716 12906 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.294868 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:42737 (local address 127.0.0.1:37294)
0807 19:53:43.307548 (+ 12680us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:43.307561 (+ 13us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:43.307711 (+ 150us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:43.308465 (+ 754us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:43.308476 (+ 11us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:43.308519 (+ 43us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:43.309053 (+ 534us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.309070 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.311163 (+ 2093us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.311170 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.313554 (+ 2384us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.313567 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.315798 (+ 2231us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.315805 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.315984 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.316015 (+ 31us) client_negotiation.cc:769] Sending connection context
0807 19:53:43.316097 (+ 82us) client_negotiation.cc:240] Negotiation successful
0807 19:53:43.316257 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":12586,"mutex_wait_us":9,"thread_start_us":11595,"threads_started":1}
I20260807 19:53:43.319175 12917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.308254 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51636 (local address 127.12.155.129:37557)
0807 19:53:43.309637 (+ 1383us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.309647 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.310279 (+ 632us) server_negotiation.cc:407] Connection header received
0807 19:53:43.310561 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.310581 (+ 20us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.310783 (+ 202us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.310937 (+ 154us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:43.311977 (+ 1040us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.313571 (+ 1594us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.316515 (+ 2944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.318049 (+ 1534us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.318268 (+ 219us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.318417 (+ 149us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.318663 (+ 246us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.318826 (+ 163us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1177,"thread_start_us":999,"threads_started":1}
I20260807 19:53:43.321537 12918 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.309577 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37557 (local address 127.0.0.1:51636)
0807 19:53:43.310167 (+ 590us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:43.310187 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:43.310387 (+ 200us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:43.311213 (+ 826us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:43.311222 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:43.311245 (+ 23us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:43.311750 (+ 505us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.311767 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.314198 (+ 2431us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.314208 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.316321 (+ 2113us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.316334 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.318296 (+ 1962us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.318304 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.318463 (+ 159us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.318493 (+ 30us) client_negotiation.cc:769] Sending connection context
0807 19:53:43.318609 (+ 116us) client_negotiation.cc:240] Negotiation successful
0807 19:53:43.321193 (+ 2584us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":444,"thread_start_us":290,"threads_started":1}
I20260807 19:53:43.321285 12568 tablet_service.cc:1467] Processing CreateTablet for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 (DEFAULT_TABLE table=test-table [id=4c80c41bc83c43d886b6354c4f0ed3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:43.321310 12781 tablet_service.cc:1467] Processing CreateTablet for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 (DEFAULT_TABLE table=test-table [id=4c80c41bc83c43d886b6354c4f0ed3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:43.322731 12781 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:43.322821 12568 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:43.325474 12347 tablet_service.cc:1467] Processing CreateTablet for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 (DEFAULT_TABLE table=test-table [id=4c80c41bc83c43d886b6354c4f0ed3b6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:43.326954 12347 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:43.334792 12919 tablet_bootstrap.cc:492] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Bootstrap starting.
I20260807 19:53:43.337337 12920 tablet_bootstrap.cc:492] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Bootstrap starting.
I20260807 19:53:43.339161 12919 tablet_bootstrap.cc:654] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:43.340996 12920 tablet_bootstrap.cc:654] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:43.340984 12921 tablet_bootstrap.cc:492] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Bootstrap starting.
I20260807 19:53:43.340975 12919 log.cc:824] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:43.342537 12920 log.cc:824] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:43.344485 12921 tablet_bootstrap.cc:654] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:43.344870 12919 tablet_bootstrap.cc:492] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: No bootstrap required, opened a new log
I20260807 19:53:43.345173 12919 ts_tablet_manager.cc:1397] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Time spent bootstrapping tablet: real 0.011s user 0.005s sys 0.002s
I20260807 19:53:43.345521 12921 log.cc:824] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:43.345847 12920 tablet_bootstrap.cc:492] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: No bootstrap required, opened a new log
I20260807 19:53:43.346132 12920 ts_tablet_manager.cc:1397] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Time spent bootstrapping tablet: real 0.009s user 0.008s sys 0.000s
I20260807 19:53:43.356426 12921 tablet_bootstrap.cc:492] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: No bootstrap required, opened a new log
I20260807 19:53:43.356700 12921 ts_tablet_manager.cc:1397] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Time spent bootstrapping tablet: real 0.016s user 0.007s sys 0.007s
I20260807 19:53:43.356760 12920 raft_consensus.cc:348] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.356760 12919 raft_consensus.cc:348] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.357208 12920 raft_consensus.cc:374] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:43.357206 12919 raft_consensus.cc:374] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:43.357316 12920 raft_consensus.cc:729] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 66384d2e8d8a422aabc9b9862961e60f, State: Initialized, Role: FOLLOWER
I20260807 19:53:43.357316 12919 raft_consensus.cc:729] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efcd6f77b3c9400486cb69bf5e32fddc, State: Initialized, Role: FOLLOWER
I20260807 19:53:43.357946 12919 consensus_queue.cc:260] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.357946 12920 consensus_queue.cc:260] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.365141 12670 heartbeater.cc:503] Master 127.12.155.190:36321 was elected leader, sending a full tablet report...
I20260807 19:53:43.365631 12921 raft_consensus.cc:348] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.366041 12921 raft_consensus.cc:374] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:43.366170 12921 raft_consensus.cc:729] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4a05134cacea49f59143315787ac2e98, State: Initialized, Role: FOLLOWER
I20260807 19:53:43.366182 12920 ts_tablet_manager.cc:1428] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Time spent starting tablet: real 0.020s user 0.019s sys 0.000s
I20260807 19:53:43.366194 12919 ts_tablet_manager.cc:1428] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Time spent starting tablet: real 0.021s user 0.012s sys 0.010s
I20260807 19:53:43.366848 12886 heartbeater.cc:503] Master 127.12.155.190:36321 was elected leader, sending a full tablet report...
I20260807 19:53:43.366781 12921 consensus_queue.cc:260] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.368523 12921 ts_tablet_manager.cc:1428] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
W20260807 19:53:43.371104 12464 tablet.cc:2369] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:43.427824 12671 tablet.cc:2369] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Can't schedule compaction. Clean time has not been advanced past its initial value.
W20260807 19:53:43.473457 12888 tablet.cc:2369] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:43.587918 12926 raft_consensus.cc:482] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:43.588292 12926 raft_consensus.cc:504] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.590143 12926 leader_election.cc:288] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 66384d2e8d8a422aabc9b9862961e60f (127.12.155.131:43583), 4a05134cacea49f59143315787ac2e98 (127.12.155.129:37557)
I20260807 19:53:43.597410 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.590701 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:42963 (local address 127.12.155.131:43583)
0807 19:53:43.590964 (+ 263us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.590972 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.591310 (+ 338us) server_negotiation.cc:407] Connection header received
0807 19:53:43.591569 (+ 259us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.591578 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.591660 (+ 82us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.591733 (+ 73us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:43.592698 (+ 965us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.593668 (+ 970us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.595622 (+ 1954us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.596418 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.596542 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.596655 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.597018 (+ 363us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.597145 (+ 127us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 19:53:43.597427 12917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.591435 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:59431 (local address 127.12.155.129:37557)
0807 19:53:43.591719 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.591724 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.591997 (+ 273us) server_negotiation.cc:407] Connection header received
0807 19:53:43.592180 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.592185 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.592266 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.592368 (+ 102us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:43.593104 (+ 736us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.593842 (+ 738us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.595706 (+ 1864us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.596461 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.596662 (+ 201us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.596737 (+ 75us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.597046 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.597167 (+ 121us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
I20260807 19:53:43.597622 12931 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.590413 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:43583 (local address 127.12.155.130:42963)
0807 19:53:43.591173 (+ 760us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:43.591195 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:43.591364 (+ 169us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:43.591995 (+ 631us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:43.591999 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:43.592122 (+ 123us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:43.592534 (+ 412us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.592548 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.593804 (+ 1256us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.593810 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.595451 (+ 1641us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.595463 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.596662 (+ 1199us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.596670 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.596855 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.596879 (+ 24us) client_negotiation.cc:769] Sending connection context
0807 19:53:43.596954 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 19:53:43.597112 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":628,"mutex_wait_us":34,"spinlock_wait_cycles":23296,"thread_start_us":398,"threads_started":1}
I20260807 19:53:43.597853 12932 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.591202 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37557 (local address 127.12.155.130:59431)
0807 19:53:43.591887 (+ 685us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:43.591902 (+ 15us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:43.592033 (+ 131us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:43.592388 (+ 355us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:43.592390 (+ 2us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:43.592408 (+ 18us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:43.592935 (+ 527us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.592948 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.593981 (+ 1033us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.593984 (+ 3us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.595539 (+ 1555us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:43.595558 (+ 19us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.596728 (+ 1170us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.596733 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:43.596869 (+ 136us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.596892 (+ 23us) client_negotiation.cc:769] Sending connection context
0807 19:53:43.597005 (+ 113us) client_negotiation.cc:240] Negotiation successful
0807 19:53:43.597138 (+ 133us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":554,"mutex_wait_us":34,"thread_start_us":361,"threads_started":1}
I20260807 19:53:43.598697 12822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d071a6dbb6f043c9adf9dbe7a4ea6cb7" candidate_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66384d2e8d8a422aabc9b9862961e60f" is_pre_election: true
I20260807 19:53:43.598805 12377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d071a6dbb6f043c9adf9dbe7a4ea6cb7" candidate_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a05134cacea49f59143315787ac2e98" is_pre_election: true
I20260807 19:53:43.599141 12822 raft_consensus.cc:2454] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efcd6f77b3c9400486cb69bf5e32fddc in term 0.
I20260807 19:53:43.599411 12377 raft_consensus.cc:2454] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate efcd6f77b3c9400486cb69bf5e32fddc in term 0.
I20260807 19:53:43.599792 12498 leader_election.cc:302] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 66384d2e8d8a422aabc9b9862961e60f, efcd6f77b3c9400486cb69bf5e32fddc; no voters:
I20260807 19:53:43.600200 12926 raft_consensus.cc:2781] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:53:43.600348 12926 raft_consensus.cc:482] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:53:43.600467 12926 raft_consensus.cc:3037] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:43.602757 12926 raft_consensus.cc:504] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.603328 12926 leader_election.cc:288] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [CANDIDATE]: Term 1 election: Requested vote from peers 66384d2e8d8a422aabc9b9862961e60f (127.12.155.131:43583), 4a05134cacea49f59143315787ac2e98 (127.12.155.129:37557)
I20260807 19:53:43.603816 12822 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d071a6dbb6f043c9adf9dbe7a4ea6cb7" candidate_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "66384d2e8d8a422aabc9b9862961e60f"
I20260807 19:53:43.603899 12377 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d071a6dbb6f043c9adf9dbe7a4ea6cb7" candidate_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4a05134cacea49f59143315787ac2e98"
I20260807 19:53:43.604045 12822 raft_consensus.cc:3037] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:43.604094 12377 raft_consensus.cc:3037] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:43.607383 12822 raft_consensus.cc:2454] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efcd6f77b3c9400486cb69bf5e32fddc in term 1.
I20260807 19:53:43.607383 12377 raft_consensus.cc:2454] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate efcd6f77b3c9400486cb69bf5e32fddc in term 1.
I20260807 19:53:43.607800 12498 leader_election.cc:302] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4a05134cacea49f59143315787ac2e98, efcd6f77b3c9400486cb69bf5e32fddc; no voters:
I20260807 19:53:43.608117 12926 raft_consensus.cc:2781] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:43.608537 12926 raft_consensus.cc:686] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 1 LEADER]: Becoming Leader. State: Replica: efcd6f77b3c9400486cb69bf5e32fddc, State: Running, Role: LEADER
I20260807 19:53:43.609139 12926 consensus_queue.cc:237] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } }
I20260807 19:53:43.613730 12126 catalog_manager.cc:5495] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc reported cstate change: term changed from 0 to 1, leader changed from <none> to efcd6f77b3c9400486cb69bf5e32fddc (127.12.155.130). New cstate: current_term: 1 leader_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "efcd6f77b3c9400486cb69bf5e32fddc" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 42737 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 } health_report { overall_health: UNKNOWN } } }
I20260807 19:53:43.686862 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.680846 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37298 (local address 127.12.155.130:42737)
0807 19:53:43.681004 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.681009 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.681042 (+ 33us) server_negotiation.cc:407] Connection header received
0807 19:53:43.681117 (+ 75us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.681121 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.681195 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.681309 (+ 114us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:53:43.681693 (+ 384us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.682886 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.684332 (+ 1446us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.685025 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.685177 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.685623 (+ 446us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:53:43.686273 (+ 650us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:53:43.686410 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.686499 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.686580 (+ 81us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":36}
I20260807 19:53:43.695057 12377 raft_consensus.cc:1261] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 1 FOLLOWER]: Refusing update from remote peer efcd6f77b3c9400486cb69bf5e32fddc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:43.695134 12822 raft_consensus.cc:1261] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 1 FOLLOWER]: Refusing update from remote peer efcd6f77b3c9400486cb69bf5e32fddc: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:43.696079 12933 consensus_queue.cc:1035] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [LEADER]: Connected to new peer: Peer: permanent_uuid: "4a05134cacea49f59143315787ac2e98" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37557 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:43.696446 12926 consensus_queue.cc:1035] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [LEADER]: Connected to new peer: Peer: permanent_uuid: "66384d2e8d8a422aabc9b9862961e60f" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 43583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:43.726223 12126 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:43.726505 12126 catalog_manager.cc:2645] Servicing DeleteTable request from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:57964:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:43.729940 12126 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9be88127adc04435a73646fbddcd5a2c: Sending DeleteTablet for 3 replicas of tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7
I20260807 19:53:43.731125 12781 tablet_service.cc:1514] Processing DeleteTablet for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:43 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:47154
I20260807 19:53:43.731164 12568 tablet_service.cc:1514] Processing DeleteTablet for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:43 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:37294
I20260807 19:53:43.731763 12347 tablet_service.cc:1514] Processing DeleteTablet for tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:43 UTC) from {username='kudu', principal='kudu/127.12.155.190@KRBTEST.COM'} at 127.0.0.1:51636
I20260807 19:53:43.733799 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 12229
I20260807 19:53:43.747057 12953 tablet_replica.cc:330] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: stopping tablet replica
I20260807 19:53:43.747804 12953 raft_consensus.cc:2229] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:53:43.748744 12953 raft_consensus.cc:2258] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:43.751555 12953 ts_tablet_manager.cc:1905] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:43.760637 12953 ts_tablet_manager.cc:1918] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:43.760916 12953 log.cc:1196] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/d071a6dbb6f043c9adf9dbe7a4ea6cb7
I20260807 19:53:43.761643 12953 ts_tablet_manager.cc:1939] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P efcd6f77b3c9400486cb69bf5e32fddc: Deleting consensus metadata
I20260807 19:53:43.762315 12954 tablet_replica.cc:330] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: stopping tablet replica
I20260807 19:53:43.763090 12954 raft_consensus.cc:2229] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:43.763981 12103 catalog_manager.cc:4841] TS efcd6f77b3c9400486cb69bf5e32fddc (127.12.155.130:42737): tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 (table test-table [id=4c80c41bc83c43d886b6354c4f0ed3b6]) successfully deleted
I20260807 19:53:43.765072 12954 raft_consensus.cc:2258] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:43.767724 12952 tablet_replica.cc:330] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: stopping tablet replica
I20260807 19:53:43.768178 12952 raft_consensus.cc:2229] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:43.768314 12954 ts_tablet_manager.cc:1905] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:43.768880 12952 raft_consensus.cc:2258] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:43.771399 12952 ts_tablet_manager.cc:1905] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Deleting tablet data with delete state TABLET_DATA_DELETED
Aug 07 19:53:43 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.129@KRBTEST.COM
I20260807 19:53:43.775588 12954 ts_tablet_manager.cc:1918] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:43.775812 12954 log.cc:1196] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/d071a6dbb6f043c9adf9dbe7a4ea6cb7
I20260807 19:53:43.776430 12954 ts_tablet_manager.cc:1939] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 4a05134cacea49f59143315787ac2e98: Deleting consensus metadata
I20260807 19:53:43.778393 12101 catalog_manager.cc:4841] TS 4a05134cacea49f59143315787ac2e98 (127.12.155.129:37557): tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 (table test-table [id=4c80c41bc83c43d886b6354c4f0ed3b6]) successfully deleted
I20260807 19:53:43.779630 12952 ts_tablet_manager.cc:1918] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:43.779819 12952 log.cc:1196] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_4.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/d071a6dbb6f043c9adf9dbe7a4ea6cb7
I20260807 19:53:43.780434 12952 ts_tablet_manager.cc:1939] T d071a6dbb6f043c9adf9dbe7a4ea6cb7 P 66384d2e8d8a422aabc9b9862961e60f: Deleting consensus metadata
I20260807 19:53:43.782531 12101 catalog_manager.cc:4841] TS 66384d2e8d8a422aabc9b9862961e60f (127.12.155.131:43583): tablet d071a6dbb6f043c9adf9dbe7a4ea6cb7 (table test-table [id=4c80c41bc83c43d886b6354c4f0ed3b6]) successfully deleted
I20260807 19:53:43.783049 12917 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.735577 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51644 (local address 127.12.155.129:37557)
0807 19:53:43.735800 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.735809 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.759218 (+ 23409us) server_negotiation.cc:407] Connection header received
0807 19:53:43.759762 (+ 544us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.759768 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.759863 (+ 95us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.759933 (+ 70us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:43.763642 (+ 3709us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.764844 (+ 1202us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.767244 (+ 2400us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.767878 (+ 634us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.768004 (+ 126us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.774252 (+ 6248us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:43.774273 (+ 21us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:43.774296 (+ 23us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:43.774352 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:43.779219 (+ 4867us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.780127 (+ 908us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.780137 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.780142 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.780357 (+ 215us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.780873 (+ 516us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.780878 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.780882 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.781393 (+ 511us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:43.781741 (+ 348us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.782157 (+ 416us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.782424 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:53:43.783826 12450 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:43.876230 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 12229
I20260807 19:53:43.903391 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 12470
Aug 07 19:53:43 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.130@KRBTEST.COM
I20260807 19:53:43.926559 12908 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:43.904231 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:37302 (local address 127.12.155.130:42737)
0807 19:53:43.904423 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:43.904429 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:43.904465 (+ 36us) server_negotiation.cc:407] Connection header received
0807 19:53:43.904659 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:43.904670 (+ 11us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:43.904753 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:43.904869 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:43.906526 (+ 1657us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.907462 (+ 936us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.908777 (+ 1315us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:43.909438 (+ 661us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:43.909562 (+ 124us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:43.919667 (+ 10105us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:43.919683 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:43.919703 (+ 20us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:43.919758 (+ 55us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:43.923717 (+ 3959us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.924394 (+ 677us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.924403 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.924407 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.924600 (+ 193us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:43.924954 (+ 354us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:43.924959 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:43.924962 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:43.925388 (+ 426us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:43.925737 (+ 349us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:43.925911 (+ 174us) server_negotiation.cc:299] Negotiation successful
0807 19:53:43.926160 (+ 249us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:53:43.927394 12662 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:44.041519 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 12470
I20260807 19:53:44.067926 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 12683
Aug 07 19:53:44 dist-test-slave-2p8l krb5kdc[12056](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132420, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.131@KRBTEST.COM
I20260807 19:53:44.083429 12916 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:44.068724 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:47164 (local address 127.12.155.131:43583)
0807 19:53:44.068947 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:44.068952 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:44.068972 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:53:44.069168 (+ 196us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:44.069172 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:44.069246 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:44.069331 (+ 85us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:44.070796 (+ 1465us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:44.071538 (+ 742us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:44.072851 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:44.073246 (+ 395us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:44.073347 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:44.077889 (+ 4542us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:44.077905 (+ 16us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:44.077923 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:44.077956 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:44.080750 (+ 2794us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:44.081469 (+ 719us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:44.081477 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:44.081479 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:44.081619 (+ 140us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:44.081968 (+ 349us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:44.081971 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:44.081973 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:44.082401 (+ 428us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:44.082621 (+ 220us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:44.082892 (+ 271us) server_negotiation.cc:299] Negotiation successful
0807 19:53:44.083049 (+ 157us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:53:44.084080 12877 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:44.174217 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 12683
I20260807 19:53:44.194721 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 12076
I20260807 19:53:44.195886 12178 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:44.307221 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 12076
2026-08-07T19:53:44Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/4 (4970 ms)
[ RUN ] EncryptionPolicyTest.TestEncryptionPolicy/5
2026-08-07T19:53:44Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:44Z Disabled control of system clock
I20260807 19:53:44.400292 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40817
--webserver_interface=127.12.155.190
--webserver_port=0
--builtin_ntp_servers=127.12.155.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40817
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 19:53:44.750589 12970 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:44.750869 12970 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:44.750952 12970 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:44.758177 12970 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:44.758279 12970 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:44.758317 12970 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:44.758380 12970 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:44.758423 12970 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:44.767787 12970 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40817
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40817
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:44.769013 12970 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:44.770789 12970 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:44.783069 12981 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:44.783093 12984 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:44.783211 12980 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:44.783990 12970 server_base.cc:1034] running on GCE node
I20260807 19:53:44.784808 12970 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:44.786275 12970 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:44.787516 12970 hybrid_clock.cc:648] HybridClock initialized: now 1786132424787475 us; error 51 us; skew 500 ppm
I20260807 19:53:44.787874 12970 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:44.790277 12970 webserver.cc:460] Webserver started at http://127.12.155.190:40379/ using document root <none> and password file <none>
I20260807 19:53:44.790997 12970 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:44.791131 12970 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:44.791462 12970 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:44.794441 12970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "9050b1d4b5284b5ca4b2ebc7119c3152"
format_stamp: "Formatted at 2026-08-07 19:53:44 on dist-test-slave-2p8l"
server_key: "4fa291ce60474c506a160ee84a11d80e"
server_key_iv: "9d1e9ee7fa875a18c296c772b97c4ce5"
server_key_version: "encryptionkey@0"
I20260807 19:53:44.795275 12970 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "9050b1d4b5284b5ca4b2ebc7119c3152"
format_stamp: "Formatted at 2026-08-07 19:53:44 on dist-test-slave-2p8l"
server_key: "4fa291ce60474c506a160ee84a11d80e"
server_key_iv: "9d1e9ee7fa875a18c296c772b97c4ce5"
server_key_version: "encryptionkey@0"
I20260807 19:53:44.800733 12970 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.003s
I20260807 19:53:44.804328 12995 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:44.805660 12970 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:53:44.805881 12970 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "9050b1d4b5284b5ca4b2ebc7119c3152"
format_stamp: "Formatted at 2026-08-07 19:53:44 on dist-test-slave-2p8l"
server_key: "4fa291ce60474c506a160ee84a11d80e"
server_key_iv: "9d1e9ee7fa875a18c296c772b97c4ce5"
server_key_version: "encryptionkey@0"
I20260807 19:53:44.806130 12970 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:44.831501 12970 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:44.832495 12970 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:44.832816 12970 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:44.853299 12970 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:40817
I20260807 19:53:44.853356 13076 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:40817 every 8 connection(s)
I20260807 19:53:44.854799 12970 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:44.858572 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 12970
I20260807 19:53:44.858744 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:44.859094 13077 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:44.859272 12910 external_mini_cluster.cc:1428] Setting key 6588bbe44a6d667a403c24c2603bf224
I20260807 19:53:44.876013 13080 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:44.861212 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:60152 (local address 127.12.155.190:40817)
0807 19:53:44.862601 (+ 1389us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:44.862619 (+ 18us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:44.862679 (+ 60us) server_negotiation.cc:407] Connection header received
0807 19:53:44.864780 (+ 2101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:44.864815 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:44.865489 (+ 674us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:44.865975 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:44.866638 (+ 663us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:44.868902 (+ 2264us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:44.870338 (+ 1436us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:44.871477 (+ 1139us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:44.871690 (+ 213us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:44.872839 (+ 1149us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:44.872853 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:44.872872 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:44.873723 (+ 851us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:44.873838 (+ 115us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:44.873875 (+ 37us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:44.874026 (+ 151us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:44.874317 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:53:44.874659 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":763,"thread_start_us":517,"threads_started":1}
I20260807 19:53:44.876509 13077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152: Bootstrap starting.
I20260807 19:53:44.880131 13077 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:44.881253 13077 log.cc:824] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:44.884426 13077 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152: No bootstrap required, opened a new log
I20260807 19:53:44.891935 13077 raft_consensus.cc:348] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40817 } }
I20260807 19:53:44.892308 13077 raft_consensus.cc:374] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:44.892427 13077 raft_consensus.cc:729] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 9050b1d4b5284b5ca4b2ebc7119c3152, State: Initialized, Role: FOLLOWER
I20260807 19:53:44.893046 13077 consensus_queue.cc:260] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40817 } }
I20260807 19:53:44.893313 13077 raft_consensus.cc:388] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:44.893453 13077 raft_consensus.cc:482] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:44.893652 13077 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:44.895895 13077 raft_consensus.cc:504] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40817 } }
I20260807 19:53:44.896402 13077 leader_election.cc:302] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 9050b1d4b5284b5ca4b2ebc7119c3152; no voters:
I20260807 19:53:44.897030 13077 leader_election.cc:288] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:44.897204 13082 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:44.897990 13082 raft_consensus.cc:686] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [term 1 LEADER]: Becoming Leader. State: Replica: 9050b1d4b5284b5ca4b2ebc7119c3152, State: Running, Role: LEADER
I20260807 19:53:44.898576 13082 consensus_queue.cc:237] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40817 } }
I20260807 19:53:44.899303 13077 sys_catalog.cc:564] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:44.901805 13083 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40817 } } }
I20260807 19:53:44.901840 13085 sys_catalog.cc:455] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 9050b1d4b5284b5ca4b2ebc7119c3152. Latest consensus state: current_term: 1 leader_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "9050b1d4b5284b5ca4b2ebc7119c3152" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40817 } } }
I20260807 19:53:44.902293 13083 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:44.902339 13085 sys_catalog.cc:458] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:44.904659 13097 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:44.909407 13097 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:44.918926 13097 catalog_manager.cc:1347] Generated new cluster ID: b3b2583f0b944891a22f3151cb212338
I20260807 19:53:44.919111 13097 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:44.926659 13097 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:44.927953 13097 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:44.941859 13097 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152: Generated new TSK 0
I20260807 19:53:44.942782 13097 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:44.956894 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.129:0
--local_ip_for_outbound_sockets=127.12.155.129
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40817
--builtin_ntp_servers=127.12.155.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
W20260807 19:53:45.316753 13115 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:45.317030 13115 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:45.317188 13115 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:45.324782 13115 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:45.324885 13115 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:45.325047 13115 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.129
I20260807 19:53:45.334174 13115 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.129:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
--webserver_interface=127.12.155.129
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.129
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:45.335462 13115 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:45.337316 13115 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:45.351043 13125 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:45.351099 13127 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:45.351121 13124 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:45.351944 13115 server_base.cc:1034] running on GCE node
I20260807 19:53:45.352500 13115 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:45.353371 13115 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:45.354573 13115 hybrid_clock.cc:648] HybridClock initialized: now 1786132425354520 us; error 69 us; skew 500 ppm
I20260807 19:53:45.354899 13115 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:45.357142 13115 webserver.cc:460] Webserver started at http://127.12.155.129:33873/ using document root <none> and password file <none>
I20260807 19:53:45.357776 13115 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:45.357864 13115 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:45.358203 13115 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:45.360972 13115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data/instance:
uuid: "5afdae2e833441d4b4befeea9a9a16d5"
format_stamp: "Formatted at 2026-08-07 19:53:45 on dist-test-slave-2p8l"
server_key: "202da0cbd9c6e3bbe666cb0795103e29"
server_key_iv: "3bff1b4aca359d2825de9db0227ad63b"
server_key_version: "encryptionkey@0"
I20260807 19:53:45.361742 13115 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance:
uuid: "5afdae2e833441d4b4befeea9a9a16d5"
format_stamp: "Formatted at 2026-08-07 19:53:45 on dist-test-slave-2p8l"
server_key: "202da0cbd9c6e3bbe666cb0795103e29"
server_key_iv: "3bff1b4aca359d2825de9db0227ad63b"
server_key_version: "encryptionkey@0"
I20260807 19:53:45.366840 13115 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:53:45.370407 13135 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:45.371703 13115 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:53:45.371879 13115 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal
uuid: "5afdae2e833441d4b4befeea9a9a16d5"
format_stamp: "Formatted at 2026-08-07 19:53:45 on dist-test-slave-2p8l"
server_key: "202da0cbd9c6e3bbe666cb0795103e29"
server_key_iv: "3bff1b4aca359d2825de9db0227ad63b"
server_key_version: "encryptionkey@0"
I20260807 19:53:45.372087 13115 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:45.402398 13115 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:45.403437 13115 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:45.403752 13115 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:45.404872 13115 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:45.406507 13115 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:45.406607 13115 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:45.406766 13115 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:45.406862 13115 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:45.439607 13115 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.129:37527
I20260807 19:53:45.439659 13321 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.129:37527 every 8 connection(s)
I20260807 19:53:45.441197 13115 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/data/info.pb
I20260807 19:53:45.446323 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13115
I20260807 19:53:45.446583 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal/instance
I20260807 19:53:45.447154 12910 external_mini_cluster.cc:1428] Setting key 0a078ae1f3ecc991cc4ce12dbf3a1403
I20260807 19:53:45.450433 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.130:0
--local_ip_for_outbound_sockets=127.12.155.130
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40817
--builtin_ntp_servers=127.12.155.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 19:53:45.456718 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:45.444197 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:34721 (local address 127.12.155.190:40817)
0807 19:53:45.444692 (+ 495us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:45.444697 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:45.445749 (+ 1052us) server_negotiation.cc:407] Connection header received
0807 19:53:45.448329 (+ 2580us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:45.448335 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:45.448432 (+ 97us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:45.448569 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:45.449808 (+ 1239us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.450758 (+ 950us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.453343 (+ 2585us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.453815 (+ 472us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.453922 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:45.455706 (+ 1784us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:45.455715 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:45.455722 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:45.455747 (+ 25us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:45.455797 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:45.455814 (+ 17us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:45.455897 (+ 83us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:45.456182 (+ 285us) server_negotiation.cc:299] Negotiation successful
0807 19:53:45.456287 (+ 105us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":379,"thread_start_us":263,"threads_started":1}
I20260807 19:53:45.458240 13327 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:45.444647 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40817 (local address 127.12.155.129:34721)
0807 19:53:45.445568 (+ 921us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:45.445613 (+ 45us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:45.448050 (+ 2437us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:45.448800 (+ 750us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:45.448808 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:45.448893 (+ 85us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:45.449599 (+ 706us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:45.449627 (+ 28us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.450920 (+ 1293us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.450929 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:45.453178 (+ 2249us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:45.453196 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.454086 (+ 890us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.454096 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:45.454445 (+ 349us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:45.455294 (+ 849us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:45.455299 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:45.455356 (+ 57us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:45.455468 (+ 112us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:45.455920 (+ 452us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:45.455935 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:45.455946 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:53:45.456161 (+ 215us) client_negotiation.cc:240] Negotiation successful
0807 19:53:45.456600 (+ 439us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":500,"thread_start_us":310,"threads_started":1}
I20260807 19:53:45.460039 13323 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40817
I20260807 19:53:45.460347 13323 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:45.461170 13323 heartbeater.cc:511] Master 127.12.155.190:40817 requested a full tablet report, sending...
I20260807 19:53:45.463827 13023 ts_manager.cc:194] Registered new tserver with Master: 5afdae2e833441d4b4befeea9a9a16d5 (127.12.155.129:37527)
I20260807 19:53:45.465490 13023 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.129:34721
W20260807 19:53:45.796079 13329 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:45.796372 13329 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:45.796538 13329 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:45.804091 13329 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:45.804199 13329 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:45.804378 13329 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.130
I20260807 19:53:45.813781 13329 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.130:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
--webserver_interface=127.12.155.130
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.130
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:45.815143 13329 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:45.816934 13329 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:45.830827 13338 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:45.830814 13337 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:45.831619 13340 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:45.832181 13329 server_base.cc:1034] running on GCE node
I20260807 19:53:45.832942 13329 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:45.833990 13329 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:45.835251 13329 hybrid_clock.cc:648] HybridClock initialized: now 1786132425835188 us; error 57 us; skew 500 ppm
I20260807 19:53:45.835609 13329 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:45.838020 13329 webserver.cc:460] Webserver started at http://127.12.155.130:39987/ using document root <none> and password file <none>
I20260807 19:53:45.838786 13329 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:45.838923 13329 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:45.839251 13329 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:45.842218 13329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data/instance:
uuid: "e336e226e30a4643bc9ce7af8aa31aa9"
format_stamp: "Formatted at 2026-08-07 19:53:45 on dist-test-slave-2p8l"
server_key: "5b044cf19894a1313541a7c5e22c4d54"
server_key_iv: "8df860c6edf148aeb47cc62dc4cf6677"
server_key_version: "encryptionkey@0"
I20260807 19:53:45.843042 13329 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance:
uuid: "e336e226e30a4643bc9ce7af8aa31aa9"
format_stamp: "Formatted at 2026-08-07 19:53:45 on dist-test-slave-2p8l"
server_key: "5b044cf19894a1313541a7c5e22c4d54"
server_key_iv: "8df860c6edf148aeb47cc62dc4cf6677"
server_key_version: "encryptionkey@0"
I20260807 19:53:45.848605 13329 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:53:45.852417 13350 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:45.854262 13329 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:45.854449 13329 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal
uuid: "e336e226e30a4643bc9ce7af8aa31aa9"
format_stamp: "Formatted at 2026-08-07 19:53:45 on dist-test-slave-2p8l"
server_key: "5b044cf19894a1313541a7c5e22c4d54"
server_key_iv: "8df860c6edf148aeb47cc62dc4cf6677"
server_key_version: "encryptionkey@0"
I20260807 19:53:45.854702 13329 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:45.880815 13329 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:45.881599 13329 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:45.881865 13329 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:45.882896 13329 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:45.884363 13329 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:45.884469 13329 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:45.884554 13329 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:45.884610 13329 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:45.919348 13329 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.130:45147
I20260807 19:53:45.919500 13530 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.130:45147 every 8 connection(s)
I20260807 19:53:45.920840 13329 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/data/info.pb
I20260807 19:53:45.925470 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13329
I20260807 19:53:45.925666 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal/instance
I20260807 19:53:45.926234 12910 external_mini_cluster.cc:1428] Setting key 712e66dbb2be8b1b1f6b8defc806677e
I20260807 19:53:45.929697 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--encrypt_data_at_rest=true
--ipki_server_key_size=768
--openssl_security_level_override=0
tserver
run
--rpc_bind_addresses=127.12.155.131:0
--local_ip_for_outbound_sockets=127.12.155.131
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40817
--builtin_ntp_servers=127.12.155.148:36519
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_trace_negotiation
--rpc_authentication=disabled with env {}
I20260807 19:53:45.936352 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:45.925529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.130:47807 (local address 127.12.155.190:40817)
0807 19:53:45.925742 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:45.925748 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:45.927378 (+ 1630us) server_negotiation.cc:407] Connection header received
0807 19:53:45.929725 (+ 2347us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:45.929729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:45.929829 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:45.929969 (+ 140us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:45.931123 (+ 1154us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.931878 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.933456 (+ 1578us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.933857 (+ 401us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.934001 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:45.935477 (+ 1476us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:45.935481 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:45.935485 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:45.935504 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:45.935536 (+ 32us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:45.935549 (+ 13us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:45.935650 (+ 101us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:45.935889 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 19:53:45.936005 (+ 116us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":86}
I20260807 19:53:45.937402 13533 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:45.926037 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40817 (local address 127.12.155.130:47807)
0807 19:53:45.927188 (+ 1151us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:45.927248 (+ 60us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:45.929361 (+ 2113us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:45.930267 (+ 906us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:45.930275 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:45.930362 (+ 87us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:45.930941 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:45.930962 (+ 21us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.932048 (+ 1086us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.932055 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:45.933294 (+ 1239us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:45.933307 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:45.934122 (+ 815us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:45.934132 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:45.934365 (+ 233us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:45.935127 (+ 762us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:45.935130 (+ 3us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:45.935169 (+ 39us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:45.935254 (+ 85us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:45.935648 (+ 394us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:45.935663 (+ 15us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:45.935674 (+ 11us) client_negotiation.cc:769] Sending connection context
0807 19:53:45.935861 (+ 187us) client_negotiation.cc:240] Negotiation successful
0807 19:53:45.936264 (+ 403us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":550,"thread_start_us":320,"threads_started":1}
I20260807 19:53:45.939059 13531 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40817
I20260807 19:53:45.939406 13531 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:45.940237 13531 heartbeater.cc:511] Master 127.12.155.190:40817 requested a full tablet report, sending...
I20260807 19:53:45.941869 13023 ts_manager.cc:194] Registered new tserver with Master: e336e226e30a4643bc9ce7af8aa31aa9 (127.12.155.130:45147)
I20260807 19:53:45.943202 13023 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.130:47807
W20260807 19:53:46.290233 13534 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:46.290548 13534 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:46.290644 13534 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:46.298578 13534 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:46.298686 13534 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:46.298794 13534 flags.cc:425] Enabled experimental flag: --local_ip_for_outbound_sockets=127.12.155.131
I20260807 19:53:46.308137 13534 tablet_server_runner.cc:78] Tablet server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:36519
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal
--rpc_trace_negotiation=true
--ipki_server_key_size=768
--openssl_security_level_override=0
--rpc_bind_addresses=127.12.155.131:0
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
--webserver_interface=127.12.155.131
--webserver_port=0
--tserver_master_addrs=127.12.155.190:40817
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--local_ip_for_outbound_sockets=127.12.155.131
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/logs
--logbuflevel=-1
--logtostderr=true
Tablet server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:46.309510 13534 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:46.311390 13534 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:46.324712 13546 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:46.324766 13545 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:46.324935 13550 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:46.325484 13534 server_base.cc:1034] running on GCE node
I20260807 19:53:46.326148 13534 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:46.327148 13534 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:46.328390 13534 hybrid_clock.cc:648] HybridClock initialized: now 1786132426328349 us; error 51 us; skew 500 ppm
I20260807 19:53:46.328719 13534 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20260807 19:53:46.331199 13534 webserver.cc:460] Webserver started at http://127.12.155.131:37781/ using document root <none> and password file <none>
I20260807 19:53:46.331889 13534 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:46.332027 13534 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:46.332367 13534 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:46.335399 13534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data/instance:
uuid: "e9372d05202748a794f1feea09391ad2"
format_stamp: "Formatted at 2026-08-07 19:53:46 on dist-test-slave-2p8l"
server_key: "749b2ab86f2d165a80616f0554061434"
server_key_iv: "4068efdc185c913c40f1c2501e6d68c8"
server_key_version: "encryptionkey@0"
I20260807 19:53:46.336208 13534 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance:
uuid: "e9372d05202748a794f1feea09391ad2"
format_stamp: "Formatted at 2026-08-07 19:53:46 on dist-test-slave-2p8l"
server_key: "749b2ab86f2d165a80616f0554061434"
server_key_iv: "4068efdc185c913c40f1c2501e6d68c8"
server_key_version: "encryptionkey@0"
I20260807 19:53:46.341403 13534 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:53:46.345517 13558 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:46.347142 13534 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:46.347335 13534 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal
uuid: "e9372d05202748a794f1feea09391ad2"
format_stamp: "Formatted at 2026-08-07 19:53:46 on dist-test-slave-2p8l"
server_key: "749b2ab86f2d165a80616f0554061434"
server_key_iv: "4068efdc185c913c40f1c2501e6d68c8"
server_key_version: "encryptionkey@0"
I20260807 19:53:46.347566 13534 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:46.363173 13534 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:46.363991 13534 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:46.364306 13534 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:46.365262 13534 txn_system_client.cc:433] TxnSystemClient initialization is disabled...
I20260807 19:53:46.366783 13534 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20260807 19:53:46.366904 13534 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:46.367046 13534 ts_tablet_manager.cc:610] Registered 0 tablets
I20260807 19:53:46.367136 13534 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:46.412317 13534 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.131:44305
I20260807 19:53:46.412374 13737 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.131:44305 every 8 connection(s)
I20260807 19:53:46.413664 13534 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/data/info.pb
I20260807 19:53:46.424142 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13534
I20260807 19:53:46.424350 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal/instance
I20260807 19:53:46.425020 12910 external_mini_cluster.cc:1428] Setting key 5eb1009245073c70aa4b452f7e2c3e1e
I20260807 19:53:46.426514 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.416351 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.131:45183 (local address 127.12.155.190:40817)
0807 19:53:46.416576 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.416582 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.417952 (+ 1370us) server_negotiation.cc:407] Connection header received
0807 19:53:46.419770 (+ 1818us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.419775 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.419861 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.419957 (+ 96us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:46.420999 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.421778 (+ 779us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.423313 (+ 1535us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.423715 (+ 402us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.423812 (+ 97us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.425496 (+ 1684us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:46.425501 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:46.425525 (+ 24us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:46.425551 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:46.425594 (+ 43us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:46.425613 (+ 19us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:46.425713 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.426029 (+ 316us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.426142 (+ 113us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":78}
I20260807 19:53:46.427574 13742 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.416850 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40817 (local address 127.12.155.131:45183)
0807 19:53:46.417781 (+ 931us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.417830 (+ 49us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:46.419502 (+ 1672us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:46.420199 (+ 697us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:46.420208 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:46.420290 (+ 82us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:53:46.420848 (+ 558us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.420864 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.421911 (+ 1047us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.421915 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.423191 (+ 1276us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.423203 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.423996 (+ 793us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.424005 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.424330 (+ 325us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.425125 (+ 795us) client_negotiation.cc:623] Initiating SASL PLAIN handshake
0807 19:53:46.425130 (+ 5us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:53:46.425206 (+ 76us) client_negotiation.cc:814] callback for SASL_CB_AUTHNAME
0807 19:53:46.425302 (+ 96us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:53:46.425779 (+ 477us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:53:46.425792 (+ 13us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:53:46.425800 (+ 8us) client_negotiation.cc:769] Sending connection context
0807 19:53:46.425999 (+ 199us) client_negotiation.cc:240] Negotiation successful
0807 19:53:46.426451 (+ 452us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":464,"thread_start_us":277,"threads_started":1}
I20260807 19:53:46.428977 13738 heartbeater.cc:347] Connected to a master server at 127.12.155.190:40817
I20260807 19:53:46.429281 13738 heartbeater.cc:464] Registering TS with master...
I20260807 19:53:46.430135 13738 heartbeater.cc:511] Master 127.12.155.190:40817 requested a full tablet report, sending...
I20260807 19:53:46.431516 13023 ts_manager.cc:194] Registered new tserver with Master: e9372d05202748a794f1feea09391ad2 (127.12.155.131:44305)
I20260807 19:53:46.432349 13023 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.12.155.131:45183
I20260807 19:53:46.440829 12910 external_mini_cluster.cc:930] 3 TS(s) registered with all masters
I20260807 19:53:46.452220 13325 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.446013 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52978 (local address 127.12.155.190:40817)
0807 19:53:46.446208 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.446212 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.446749 (+ 537us) server_negotiation.cc:407] Connection header received
0807 19:53:46.446907 (+ 158us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.446911 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.446997 (+ 86us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.447084 (+ 87us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:46.447718 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.448424 (+ 706us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.449902 (+ 1478us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.450397 (+ 495us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.450507 (+ 110us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.451585 (+ 1078us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:46.451589 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:46.451592 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:46.451609 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:46.451636 (+ 27us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:46.451648 (+ 12us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:46.451722 (+ 74us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.451899 (+ 177us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.451991 (+ 92us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:53:46.455855 13023 catalog_manager.cc:1908] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52978:
name: "test-table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "val"
type: INT32
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20260807 19:53:46.462795 13023 catalog_manager.cc:6854] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20260807 19:53:46.468737 13323 heartbeater.cc:503] Master 127.12.155.190:40817 was elected leader, sending a full tablet report...
I20260807 19:53:46.488423 13762 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.475216 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:44305 (local address 127.0.0.1:42018)
0807 19:53:46.475994 (+ 778us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.476055 (+ 61us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:46.476236 (+ 181us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:46.477513 (+ 1277us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:46.477523 (+ 10us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:46.477556 (+ 33us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:46.478159 (+ 603us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.478179 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.481253 (+ 3074us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.481262 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.484963 (+ 3701us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.484986 (+ 23us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.487413 (+ 2427us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.487422 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.487636 (+ 214us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.487689 (+ 53us) client_negotiation.cc:769] Sending connection context
0807 19:53:46.487796 (+ 107us) client_negotiation.cc:240] Negotiation successful
0807 19:53:46.487987 (+ 191us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":511,"mutex_wait_us":156,"thread_start_us":551,"threads_started":1}
I20260807 19:53:46.489104 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.475611 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42018 (local address 127.12.155.131:44305)
0807 19:53:46.476791 (+ 1180us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.476798 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.476826 (+ 28us) server_negotiation.cc:407] Connection header received
0807 19:53:46.476944 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.476952 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.477190 (+ 238us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.478342 (+ 1152us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:46.478922 (+ 580us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.481050 (+ 2128us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.485329 (+ 4279us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.487203 (+ 1874us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.488295 (+ 1092us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.488519 (+ 224us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.488609 (+ 90us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.488779 (+ 170us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1033,"thread_start_us":1117,"threads_started":1}
I20260807 19:53:46.489085 13763 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.475510 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:45147 (local address 127.0.0.1:40928)
0807 19:53:46.476239 (+ 729us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.476261 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:46.476382 (+ 121us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:46.477810 (+ 1428us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:46.477818 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:46.477858 (+ 40us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:46.478858 (+ 1000us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.478876 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.481336 (+ 2460us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.481344 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.484983 (+ 3639us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.485005 (+ 22us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.488056 (+ 3051us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.488065 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.488335 (+ 270us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.488391 (+ 56us) client_negotiation.cc:769] Sending connection context
0807 19:53:46.488512 (+ 121us) client_negotiation.cc:240] Negotiation successful
0807 19:53:46.488627 (+ 115us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":592,"mutex_wait_us":215,"thread_start_us":406,"threads_started":1}
I20260807 19:53:46.490223 13767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.476529 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40928 (local address 127.12.155.130:45147)
0807 19:53:46.477096 (+ 567us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.477105 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.477131 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:53:46.477234 (+ 103us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.477241 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.477451 (+ 210us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.478325 (+ 874us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:46.479104 (+ 779us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.481122 (+ 2018us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.485347 (+ 4225us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.487335 (+ 1988us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.487531 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.487834 (+ 303us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.489491 (+ 1657us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.489733 (+ 242us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":403,"thread_start_us":779,"threads_started":1}
I20260807 19:53:46.493135 13633 tablet_service.cc:1467] Processing CreateTablet for tablet 2e89414712a74af586f26c2503040354 (DEFAULT_TABLE table=test-table [id=952de3d5d2014962869baff0fd1cabc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:46.493707 13428 tablet_service.cc:1467] Processing CreateTablet for tablet 2e89414712a74af586f26c2503040354 (DEFAULT_TABLE table=test-table [id=952de3d5d2014962869baff0fd1cabc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:46.494800 13633 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e89414712a74af586f26c2503040354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:46.495064 13428 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e89414712a74af586f26c2503040354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:46.500046 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.477195 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52282)
0807 19:53:46.486897 (+ 9702us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.486921 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:46.487035 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:46.492450 (+ 5415us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:46.492455 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:46.492484 (+ 29us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:46.492854 (+ 370us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.492867 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.494823 (+ 1956us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.494830 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.496802 (+ 1972us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.496819 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.499237 (+ 2418us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.499243 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.499422 (+ 179us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.499461 (+ 39us) client_negotiation.cc:769] Sending connection context
0807 19:53:46.499561 (+ 100us) client_negotiation.cc:240] Negotiation successful
0807 19:53:46.499719 (+ 158us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":9577,"thread_start_us":9925,"threads_started":1}
I20260807 19:53:46.500180 13771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.477516 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52282 (local address 127.12.155.129:37527)
0807 19:53:46.491831 (+ 14315us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.491839 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.491870 (+ 31us) server_negotiation.cc:407] Connection header received
0807 19:53:46.491967 (+ 97us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.491974 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.492231 (+ 257us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.492431 (+ 200us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:46.493054 (+ 623us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.494640 (+ 1586us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.497026 (+ 2386us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.498933 (+ 1907us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.499150 (+ 217us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.499429 (+ 279us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.499621 (+ 192us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.499794 (+ 173us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":14133,"thread_start_us":14004,"threads_started":1}
I20260807 19:53:46.504292 13212 tablet_service.cc:1467] Processing CreateTablet for tablet 2e89414712a74af586f26c2503040354 (DEFAULT_TABLE table=test-table [id=952de3d5d2014962869baff0fd1cabc6]), partition=RANGE (key) PARTITION UNBOUNDED
I20260807 19:53:46.505806 13212 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 2e89414712a74af586f26c2503040354. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:46.507988 13773 tablet_bootstrap.cc:492] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Bootstrap starting.
I20260807 19:53:46.509920 13774 tablet_bootstrap.cc:492] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Bootstrap starting.
I20260807 19:53:46.513062 13773 tablet_bootstrap.cc:654] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:46.513556 13774 tablet_bootstrap.cc:654] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:46.514420 13773 log.cc:824] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:46.514771 13774 log.cc:824] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:46.517745 13773 tablet_bootstrap.cc:492] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: No bootstrap required, opened a new log
I20260807 19:53:46.518040 13773 ts_tablet_manager.cc:1397] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.005s
I20260807 19:53:46.518637 13774 tablet_bootstrap.cc:492] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: No bootstrap required, opened a new log
I20260807 19:53:46.518904 13774 ts_tablet_manager.cc:1397] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Time spent bootstrapping tablet: real 0.009s user 0.007s sys 0.000s
I20260807 19:53:46.523084 13781 tablet_bootstrap.cc:492] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Bootstrap starting.
I20260807 19:53:46.526408 13781 tablet_bootstrap.cc:654] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:46.527406 13781 log.cc:824] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:46.528872 13773 raft_consensus.cc:348] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.529359 13773 raft_consensus.cc:374] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:46.529470 13773 raft_consensus.cc:729] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e336e226e30a4643bc9ce7af8aa31aa9, State: Initialized, Role: FOLLOWER
I20260807 19:53:46.530401 13781 tablet_bootstrap.cc:492] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: No bootstrap required, opened a new log
I20260807 19:53:46.530251 13773 consensus_queue.cc:260] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.530228 13774 raft_consensus.cc:348] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.530695 13781 ts_tablet_manager.cc:1397] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Time spent bootstrapping tablet: real 0.008s user 0.007s sys 0.000s
I20260807 19:53:46.530682 13774 raft_consensus.cc:374] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:46.530783 13774 raft_consensus.cc:729] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e9372d05202748a794f1feea09391ad2, State: Initialized, Role: FOLLOWER
I20260807 19:53:46.531518 13774 consensus_queue.cc:260] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.532758 13738 heartbeater.cc:503] Master 127.12.155.190:40817 was elected leader, sending a full tablet report...
I20260807 19:53:46.533571 13774 ts_tablet_manager.cc:1428] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Time spent starting tablet: real 0.014s user 0.013s sys 0.000s
I20260807 19:53:46.534868 13531 heartbeater.cc:503] Master 127.12.155.190:40817 was elected leader, sending a full tablet report...
I20260807 19:53:46.535355 13773 ts_tablet_manager.cc:1428] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Time spent starting tablet: real 0.017s user 0.014s sys 0.001s
I20260807 19:53:46.540586 13781 raft_consensus.cc:348] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.540962 13781 raft_consensus.cc:374] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:46.541077 13781 raft_consensus.cc:729] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5afdae2e833441d4b4befeea9a9a16d5, State: Initialized, Role: FOLLOWER
I20260807 19:53:46.541617 13781 consensus_queue.cc:260] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.543097 13781 ts_tablet_manager.cc:1428] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Time spent starting tablet: real 0.012s user 0.008s sys 0.004s
I20260807 19:53:46.658375 13786 raft_consensus.cc:482] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20260807 19:53:46.658715 13786 raft_consensus.cc:504] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.660697 13786 leader_election.cc:288] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e9372d05202748a794f1feea09391ad2 (127.12.155.131:44305), e336e226e30a4643bc9ce7af8aa31aa9 (127.12.155.130:45147)
W20260807 19:53:46.665462 13739 tablet.cc:2369] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:46.667893 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.661159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:47581 (local address 127.12.155.131:44305)
0807 19:53:46.661386 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.661393 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.661848 (+ 455us) server_negotiation.cc:407] Connection header received
0807 19:53:46.662130 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.662140 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.662203 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.662307 (+ 104us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:46.662941 (+ 634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.663680 (+ 739us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.665661 (+ 1981us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.666938 (+ 1277us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.667119 (+ 181us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.667199 (+ 80us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.667509 (+ 310us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.667654 (+ 145us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:53:46.668020 13767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.661448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.12.155.129:59859 (local address 127.12.155.130:45147)
0807 19:53:46.661668 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.661675 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.662095 (+ 420us) server_negotiation.cc:407] Connection header received
0807 19:53:46.662320 (+ 225us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.662324 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.662395 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.662498 (+ 103us) server_negotiation.cc:226] Negotiated authn=CERTIFICATE
0807 19:53:46.663130 (+ 632us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.663800 (+ 670us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.665921 (+ 2121us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.667133 (+ 1212us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.667283 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.667328 (+ 45us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.667628 (+ 300us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.667756 (+ 128us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":65}
I20260807 19:53:46.668056 13788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.661010 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.130:45147 (local address 127.12.155.129:59859)
0807 19:53:46.661957 (+ 947us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.661976 (+ 19us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:46.662164 (+ 188us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:46.662521 (+ 357us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:46.662526 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:46.662551 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:46.662972 (+ 421us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.662981 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.663948 (+ 967us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.663954 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.665710 (+ 1756us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.665726 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.667306 (+ 1580us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.667312 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.667481 (+ 169us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.667509 (+ 28us) client_negotiation.cc:769] Sending connection context
0807 19:53:46.667584 (+ 75us) client_negotiation.cc:240] Negotiation successful
0807 19:53:46.667677 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":817,"mutex_wait_us":40,"thread_start_us":661,"threads_started":1}
I20260807 19:53:46.668313 13787 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.660930 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.131:44305 (local address 127.12.155.129:47581)
0807 19:53:46.661723 (+ 793us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.661741 (+ 18us) client_negotiation.cc:174] Beginning negotiation
0807 19:53:46.661944 (+ 203us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:53:46.662330 (+ 386us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:53:46.662342 (+ 12us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:53:46.662367 (+ 25us) client_negotiation.cc:189] Negotiated authn=CERTIFICATE
0807 19:53:46.662785 (+ 418us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.662797 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.663825 (+ 1028us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.663831 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.665454 (+ 1623us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:53:46.665474 (+ 20us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.667134 (+ 1660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.667139 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:53:46.667327 (+ 188us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.667363 (+ 36us) client_negotiation.cc:769] Sending connection context
0807 19:53:46.667468 (+ 105us) client_negotiation.cc:240] Negotiation successful
0807 19:53:46.667609 (+ 141us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":666,"mutex_wait_us":58,"thread_start_us":383,"threads_started":1}
I20260807 19:53:46.669185 13461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e89414712a74af586f26c2503040354" candidate_uuid: "5afdae2e833441d4b4befeea9a9a16d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" is_pre_election: true
I20260807 19:53:46.669305 13670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e89414712a74af586f26c2503040354" candidate_uuid: "5afdae2e833441d4b4befeea9a9a16d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9372d05202748a794f1feea09391ad2" is_pre_election: true
I20260807 19:53:46.669822 13461 raft_consensus.cc:2454] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5afdae2e833441d4b4befeea9a9a16d5 in term 0.
I20260807 19:53:46.669822 13670 raft_consensus.cc:2454] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5afdae2e833441d4b4befeea9a9a16d5 in term 0.
I20260807 19:53:46.670621 13138 leader_election.cc:302] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5afdae2e833441d4b4befeea9a9a16d5, e336e226e30a4643bc9ce7af8aa31aa9; no voters:
I20260807 19:53:46.671051 13786 raft_consensus.cc:2781] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20260807 19:53:46.671226 13786 raft_consensus.cc:482] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20260807 19:53:46.671342 13786 raft_consensus.cc:3037] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:46.673595 13786 raft_consensus.cc:504] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.674292 13786 leader_election.cc:288] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [CANDIDATE]: Term 1 election: Requested vote from peers e9372d05202748a794f1feea09391ad2 (127.12.155.131:44305), e336e226e30a4643bc9ce7af8aa31aa9 (127.12.155.130:45147)
I20260807 19:53:46.674839 13670 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e89414712a74af586f26c2503040354" candidate_uuid: "5afdae2e833441d4b4befeea9a9a16d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e9372d05202748a794f1feea09391ad2"
I20260807 19:53:46.674885 13461 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2e89414712a74af586f26c2503040354" candidate_uuid: "5afdae2e833441d4b4befeea9a9a16d5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e336e226e30a4643bc9ce7af8aa31aa9"
W20260807 19:53:46.674961 13532 tablet.cc:2369] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:46.675063 13670 raft_consensus.cc:3037] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:46.675130 13461 raft_consensus.cc:3037] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:46.677758 13670 raft_consensus.cc:2454] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5afdae2e833441d4b4befeea9a9a16d5 in term 1.
I20260807 19:53:46.678014 13461 raft_consensus.cc:2454] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5afdae2e833441d4b4befeea9a9a16d5 in term 1.
I20260807 19:53:46.678284 13139 leader_election.cc:302] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5afdae2e833441d4b4befeea9a9a16d5, e9372d05202748a794f1feea09391ad2; no voters:
I20260807 19:53:46.678623 13786 raft_consensus.cc:2781] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:46.679162 13786 raft_consensus.cc:686] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 1 LEADER]: Becoming Leader. State: Replica: 5afdae2e833441d4b4befeea9a9a16d5, State: Running, Role: LEADER
I20260807 19:53:46.679713 13786 consensus_queue.cc:237] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } }
I20260807 19:53:46.684674 13017 catalog_manager.cc:5495] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5afdae2e833441d4b4befeea9a9a16d5 (127.12.155.129). New cstate: current_term: 1 leader_uuid: "5afdae2e833441d4b4befeea9a9a16d5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5afdae2e833441d4b4befeea9a9a16d5" member_type: VOTER last_known_addr { host: "127.12.155.129" port: 37527 } health_report { overall_health: HEALTHY } } }
W20260807 19:53:46.693722 13324 tablet.cc:2369] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:53:46.736614 13771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.730603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52284 (local address 127.12.155.129:37527)
0807 19:53:46.730841 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.730848 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.730892 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:53:46.731031 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.731035 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.731134 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.731312 (+ 178us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:53:46.731770 (+ 458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.732571 (+ 801us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.734188 (+ 1617us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.734662 (+ 474us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.734826 (+ 164us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.735405 (+ 579us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:53:46.735970 (+ 565us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:53:46.736160 (+ 190us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.736226 (+ 66us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.736311 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":80}
I20260807 19:53:46.745014 13461 raft_consensus.cc:1261] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 1 FOLLOWER]: Refusing update from remote peer 5afdae2e833441d4b4befeea9a9a16d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:46.745043 13670 raft_consensus.cc:1261] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 1 FOLLOWER]: Refusing update from remote peer 5afdae2e833441d4b4befeea9a9a16d5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:53:46.746012 13790 consensus_queue.cc:1035] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e9372d05202748a794f1feea09391ad2" member_type: VOTER last_known_addr { host: "127.12.155.131" port: 44305 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:46.746459 13786 consensus_queue.cc:1035] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e336e226e30a4643bc9ce7af8aa31aa9" member_type: VOTER last_known_addr { host: "127.12.155.130" port: 45147 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:53:46.758265 13793 mvcc.cc:205] Tried to move back new op lower bound from 7315998419936722944 to 7315998419683676160. Current Snapshot: MvccSnapshot[applied={T|T < 7315998419936722944}]
I20260807 19:53:46.779029 13023 catalog_manager.cc:2461] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:52978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:46.779325 13023 catalog_manager.cc:2645] Servicing DeleteTable request from {username='slave'} at 127.0.0.1:52978:
table { table_name: "test-table" } modify_external_catalogs: true
I20260807 19:53:46.782820 13023 catalog_manager.cc:5782] T 00000000000000000000000000000000 P 9050b1d4b5284b5ca4b2ebc7119c3152: Sending DeleteTablet for 3 replicas of tablet 2e89414712a74af586f26c2503040354
I20260807 19:53:46.784005 13212 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e89414712a74af586f26c2503040354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:46 UTC) from {username='slave'} at 127.0.0.1:52282
I20260807 19:53:46.783991 13428 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e89414712a74af586f26c2503040354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:46 UTC) from {username='slave'} at 127.0.0.1:40928
I20260807 19:53:46.784071 13633 tablet_service.cc:1514] Processing DeleteTablet for tablet 2e89414712a74af586f26c2503040354 with delete_type TABLET_DATA_DELETED (Table deleted at 2026-08-07 19:53:46 UTC) from {username='slave'} at 127.0.0.1:42018
I20260807 19:53:46.786497 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13115
I20260807 19:53:46.794994 13818 tablet_replica.cc:330] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: stopping tablet replica
I20260807 19:53:46.795797 13818 raft_consensus.cc:2229] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 1 LEADER]: Raft consensus shutting down.
I20260807 19:53:46.796798 13818 raft_consensus.cc:2258] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:46.798029 13817 tablet_replica.cc:330] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: stopping tablet replica
I20260807 19:53:46.798557 13819 tablet_replica.cc:330] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: stopping tablet replica
I20260807 19:53:46.799113 13819 raft_consensus.cc:2229] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:46.799696 13819 raft_consensus.cc:2258] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:46.799834 13818 ts_tablet_manager.cc:1905] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:46.802327 13819 ts_tablet_manager.cc:1905] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:46.807221 13771 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.788016 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52288 (local address 127.12.155.129:37527)
0807 19:53:46.788211 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.788223 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.792804 (+ 4581us) server_negotiation.cc:407] Connection header received
0807 19:53:46.793597 (+ 793us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.793603 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.793713 (+ 110us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.793822 (+ 109us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:46.799002 (+ 5180us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.800227 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.802603 (+ 2376us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.803304 (+ 701us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.803413 (+ 109us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.805255 (+ 1842us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:46.805267 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:46.805285 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:46.806253 (+ 968us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:46.806312 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:46.806340 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:46.806445 (+ 105us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.806735 (+ 290us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.806849 (+ 114us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:53:46.807793 13818 ts_tablet_manager.cc:1918] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:46.808400 13817 raft_consensus.cc:2229] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 1 FOLLOWER]: Raft consensus shutting down.
I20260807 19:53:46.808976 13817 raft_consensus.cc:2258] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9 [term 1 FOLLOWER]: Raft consensus is shut down!
I20260807 19:53:46.808718 13313 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:46.809458 13818 log.cc:1196] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-0/wal/wals/2e89414712a74af586f26c2503040354
I20260807 19:53:46.810731 13819 ts_tablet_manager.cc:1918] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:46.810904 13819 log.cc:1196] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-2/wal/wals/2e89414712a74af586f26c2503040354
I20260807 19:53:46.811334 13817 ts_tablet_manager.cc:1905] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Deleting tablet data with delete state TABLET_DATA_DELETED
I20260807 19:53:46.811467 13819 ts_tablet_manager.cc:1939] T 2e89414712a74af586f26c2503040354 P e9372d05202748a794f1feea09391ad2: Deleting consensus metadata
I20260807 19:53:46.813019 12997 catalog_manager.cc:4841] TS e9372d05202748a794f1feea09391ad2 (127.12.155.131:44305): tablet 2e89414712a74af586f26c2503040354 (table test-table [id=952de3d5d2014962869baff0fd1cabc6]) successfully deleted
I20260807 19:53:46.818991 13817 ts_tablet_manager.cc:1918] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: tablet deleted with delete type TABLET_DATA_DELETED: last-logged OpId 1.2
I20260807 19:53:46.819175 13817 log.cc:1196] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Deleting WAL directory at /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.EncryptionPolicyTest.TestEncryptionPolicy_5.1786132073392555-12910-0/minicluster-data/ts-1/wal/wals/2e89414712a74af586f26c2503040354
I20260807 19:53:46.819656 13817 ts_tablet_manager.cc:1939] T 2e89414712a74af586f26c2503040354 P e336e226e30a4643bc9ce7af8aa31aa9: Deleting consensus metadata
I20260807 19:53:46.821197 12996 catalog_manager.cc:4841] TS e336e226e30a4643bc9ce7af8aa31aa9 (127.12.155.130:45147): tablet 2e89414712a74af586f26c2503040354 (table test-table [id=952de3d5d2014962869baff0fd1cabc6]) successfully deleted
I20260807 19:53:46.930835 13818 ts_tablet_manager.cc:1939] T 2e89414712a74af586f26c2503040354 P 5afdae2e833441d4b4befeea9a9a16d5: Deleting consensus metadata
I20260807 19:53:46.930915 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13115
I20260807 19:53:46.962765 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13329
W20260807 19:53:46.962750 12997 proxy.cc:239] Call had error, refreshing address and retrying: Network error: recv got EOF from 127.12.155.129:37527 (error 108)
I20260807 19:53:46.964597 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.964045 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52292)
0807 19:53:46.964266 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:46.964389 (+ 123us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 19:53:46.964877 12997 catalog_manager.cc:4584] TS 5afdae2e833441d4b4befeea9a9a16d5 (127.12.155.129:37527): DeleteTablet:TABLET_DATA_DELETED RPC failed for tablet 2e89414712a74af586f26c2503040354: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
I20260807 19:53:46.970000 13767 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:46.963603 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:40938 (local address 127.12.155.130:45147)
0807 19:53:46.963854 (+ 251us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:46.963862 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:46.963956 (+ 94us) server_negotiation.cc:407] Connection header received
0807 19:53:46.964229 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:46.964235 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:46.964347 (+ 112us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:46.964448 (+ 101us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:46.964985 (+ 537us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.965829 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.967142 (+ 1313us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:46.967550 (+ 408us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:46.967653 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:46.968722 (+ 1069us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:46.968732 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:46.968746 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:46.969356 (+ 610us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:46.969406 (+ 50us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:46.969427 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:46.969526 (+ 99us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:46.969648 (+ 122us) server_negotiation.cc:299] Negotiation successful
0807 19:53:46.969737 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
I20260807 19:53:46.970880 13523 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:47.018525 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.018031 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52308)
0807 19:53:47.018286 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:47.018373 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":118}
I20260807 19:53:47.019589 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.019222 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52322)
0807 19:53:47.019378 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:47.019455 (+ 77us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
I20260807 19:53:47.062855 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13329
I20260807 19:53:47.080327 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.079609 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52336)
0807 19:53:47.079908 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:47.080077 (+ 169us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 19:53:47.081517 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.081079 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52338)
0807 19:53:47.081262 (+ 183us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:47.081361 (+ 99us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
I20260807 19:53:47.089085 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13534
I20260807 19:53:47.095876 13766 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.089871 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42030 (local address 127.12.155.131:44305)
0807 19:53:47.090038 (+ 167us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:47.090042 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:47.090119 (+ 77us) server_negotiation.cc:407] Connection header received
0807 19:53:47.090258 (+ 139us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:47.090263 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:47.090364 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:47.090452 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:47.090867 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:47.091576 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:47.092948 (+ 1372us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:47.093321 (+ 373us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:47.093415 (+ 94us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:47.094621 (+ 1206us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:47.094631 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:47.094647 (+ 16us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:47.095235 (+ 588us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:47.095282 (+ 47us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:47.095303 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:47.095399 (+ 96us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:47.095543 (+ 144us) server_negotiation.cc:299] Negotiation successful
0807 19:53:47.095631 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":57}
I20260807 19:53:47.096503 13730 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:47.162446 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.161866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52352)
0807 19:53:47.162165 (+ 299us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:47.162266 (+ 101us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 19:53:47.163585 13768 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:47.163156 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.129:37527 (local address 127.0.0.1:52368)
0807 19:53:47.163362 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 19:53:47.163473 (+ 111us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.129:37527: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":96}
I20260807 19:53:47.190598 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13534
I20260807 19:53:47.215940 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 12970
I20260807 19:53:47.217058 13070 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:47.325922 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 12970
2026-08-07T19:53:47Z chronyd exiting
[ OK ] EncryptionPolicyTest.TestEncryptionPolicy/5 (3021 ms)
[----------] 6 tests from EncryptionPolicyTest (23985 ms total)
[----------] 18 tests from AuthTokenIssuingTest
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/0
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:47 dist-test-slave-2p8l krb5kdc[13831](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:47 dist-test-slave-2p8l krb5kdc[13831](info): set up 2 sockets
Aug 07 19:53:47 dist-test-slave-2p8l krb5kdc[13831](info): commencing operation
krb5kdc: starting...
W20260807 19:53:48.755537 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.378s user 0.001s sys 0.039s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:48 dist-test-slave-2p8l krb5kdc[13831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:48Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:48Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:53:49.065506 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36569
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:36703
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:36569
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:49.408018 13852 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:49.408322 13852 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:49.408481 13852 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:49.415570 13852 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:49.415709 13852 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:49.415799 13852 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:49.415916 13852 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:49.416002 13852 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:49.425594 13852 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:36703
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:36569
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:36569
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:49.426924 13852 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:49.428275 13852 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:49.440623 13867 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:49.440572 13863 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:49.440639 13861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:49.441318 13852 server_base.cc:1034] running on GCE node
I20260807 19:53:49.442126 13852 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:49.443467 13852 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:49.444715 13852 hybrid_clock.cc:648] HybridClock initialized: now 1786132429444661 us; error 61 us; skew 500 ppm
I20260807 19:53:49.445103 13852 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:49 dist-test-slave-2p8l krb5kdc[13831](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132429, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:49.453859 13852 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:53:49.455444 13852 webserver.cc:460] Webserver started at http://127.0.0.1:46601/ using document root <none> and password file <none>
I20260807 19:53:49.456149 13852 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:49.456303 13852 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:49.456619 13852 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:49.459659 13852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37"
format_stamp: "Formatted at 2026-08-07 19:53:49 on dist-test-slave-2p8l"
server_key: "8212e2b6c2b1c1de382665455d4c0c27"
server_key_iv: "a0435852cc0f238471c324845e7d02ba"
server_key_version: "encryptionkey@0"
I20260807 19:53:49.460436 13852 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37"
format_stamp: "Formatted at 2026-08-07 19:53:49 on dist-test-slave-2p8l"
server_key: "8212e2b6c2b1c1de382665455d4c0c27"
server_key_iv: "a0435852cc0f238471c324845e7d02ba"
server_key_version: "encryptionkey@0"
I20260807 19:53:49.465541 13852 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:53:49.469054 13877 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:49.470418 13852 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:49.470599 13852 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37"
format_stamp: "Formatted at 2026-08-07 19:53:49 on dist-test-slave-2p8l"
server_key: "8212e2b6c2b1c1de382665455d4c0c27"
server_key_iv: "a0435852cc0f238471c324845e7d02ba"
server_key_version: "encryptionkey@0"
I20260807 19:53:49.470804 13852 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:49.500939 13852 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:49.505602 13852 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:49.505921 13852 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:49.525214 13852 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:36569
I20260807 19:53:49.525255 13951 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:36569 every 8 connection(s)
I20260807 19:53:49.526724 13852 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:49.529237 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 13852
I20260807 19:53:49.529489 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_0.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:49.530364 12910 external_mini_cluster.cc:1428] Setting key a838c89ce89bebf4120c4f6f7766260d
I20260807 19:53:49.531123 13952 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:49.543663 13952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37: Bootstrap starting.
Aug 07 19:53:49 dist-test-slave-2p8l krb5kdc[13831](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132428, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 19:53:49.546977 13952 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:49.548409 13952 log.cc:824] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:49.551960 13952 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37: No bootstrap required, opened a new log
I20260807 19:53:49.554423 13958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:49.532465 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:33175 (local address 127.0.0.1:36569)
0807 19:53:49.533291 (+ 826us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:49.533303 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:49.533347 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:53:49.534966 (+ 1619us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:49.534988 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:49.535355 (+ 367us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:49.535769 (+ 414us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:49.537270 (+ 1501us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:49.538681 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:49.539951 (+ 1270us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:49.540650 (+ 699us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:49.540865 (+ 215us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:49.545313 (+ 4448us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:49.545321 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:49.545334 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:49.545368 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:49.549265 (+ 3897us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:49.550271 (+ 1006us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:49.550279 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:49.550287 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:49.550498 (+ 211us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:49.550920 (+ 422us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:49.550925 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:49.550928 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:49.551626 (+ 698us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:49.551965 (+ 339us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:49.552452 (+ 487us) server_negotiation.cc:299] Negotiation successful
0807 19:53:49.552935 (+ 483us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":625,"thread_start_us":364,"threads_started":1}
I20260807 19:53:49.558579 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:53:49.561431 13952 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36569 } }
I20260807 19:53:49.561862 13952 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:49.561991 13952 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5435ff9d8dec4aa0ac7aec04e2e86b37, State: Initialized, Role: FOLLOWER
I20260807 19:53:49.562646 13952 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36569 } }
I20260807 19:53:49.562892 13952 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:49.563073 13952 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:49.563329 13952 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:49.566757 13952 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36569 } }
I20260807 19:53:49.567306 13952 leader_election.cc:302] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5435ff9d8dec4aa0ac7aec04e2e86b37; no voters:
I20260807 19:53:49.568005 13952 leader_election.cc:288] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:49.568099 13965 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:49.570036 13952 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:49.574035 13965 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [term 1 LEADER]: Becoming Leader. State: Replica: 5435ff9d8dec4aa0ac7aec04e2e86b37, State: Running, Role: LEADER
I20260807 19:53:49.574896 13965 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36569 } }
I20260807 19:53:49.578750 13967 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5435ff9d8dec4aa0ac7aec04e2e86b37. Latest consensus state: current_term: 1 leader_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36569 } } }
I20260807 19:53:49.579145 13967 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:49.579674 13966 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5435ff9d8dec4aa0ac7aec04e2e86b37" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 36569 } } }
I20260807 19:53:49.579999 13966 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:49.600528 13958 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:49.563433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59779 (local address 127.0.0.1:36569)
0807 19:53:49.563646 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:49.563657 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:49.564077 (+ 420us) server_negotiation.cc:407] Connection header received
0807 19:53:49.564264 (+ 187us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:49.564267 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:49.564330 (+ 63us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:49.564410 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:49.566329 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:49.567170 (+ 841us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:49.569148 (+ 1978us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:49.570123 (+ 975us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:49.570282 (+ 159us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:49.574267 (+ 3985us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:49.574278 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:49.574286 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:49.574346 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:49.579678 (+ 5332us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:49.581043 (+ 1365us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:49.581051 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:49.581058 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:49.581318 (+ 260us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:49.582031 (+ 713us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:49.582039 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:49.582045 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:49.582563 (+ 518us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:49.599379 (+ 16816us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:49.599655 (+ 276us) server_negotiation.cc:299] Negotiation successful
0807 19:53:49.599927 (+ 272us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:53:49.603219 13974 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:49.616551 13974 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:49.627568 13974 catalog_manager.cc:1347] Generated new cluster ID: 95f6164723d342318a39eda3ff4b87b9
I20260807 19:53:49.627704 13974 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:49.659902 13974 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:49.661626 13974 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:49.668851 13974 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5435ff9d8dec4aa0ac7aec04e2e86b37: Generated new TSK 0
I20260807 19:53:49.669673 13974 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:49.676805 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 13852
I20260807 19:53:49.678139 13946 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:49.769465 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 13852
W20260807 19:53:49.794389 13829 connection.cc:535] client connection to 127.0.0.1:36569 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:36569): Connection reset by peer (error 104)
2026-08-07T19:53:49Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/0 (2436 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/1
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:49 dist-test-slave-2p8l krb5kdc[14003](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:49 dist-test-slave-2p8l krb5kdc[14003](info): set up 2 sockets
Aug 07 19:53:49 dist-test-slave-2p8l krb5kdc[14003](info): commencing operation
krb5kdc: starting...
W20260807 19:53:51.132524 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.000s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:51 dist-test-slave-2p8l krb5kdc[14003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132431, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:51Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:51Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:53:51.439213 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37613
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37613
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:51.787752 14024 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:51.788112 14024 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:51.788280 14024 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:51.795730 14024 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:51.795864 14024 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:51.795979 14024 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:51.796093 14024 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:51.796155 14024 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:51.806321 14024 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37613
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37613
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:51.807641 14024 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:51.809000 14024 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:51.821311 14035 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:51.821391 14032 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:51.821527 14038 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:51.822522 14024 server_base.cc:1034] running on GCE node
I20260807 19:53:51.823348 14024 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:51.824806 14024 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:51.826045 14024 hybrid_clock.cc:648] HybridClock initialized: now 1786132431825994 us; error 54 us; skew 500 ppm
I20260807 19:53:51.826454 14024 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:51 dist-test-slave-2p8l krb5kdc[14003](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132431, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:51.829782 14024 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:53:51.831414 14024 webserver.cc:460] Webserver started at http://127.0.0.1:33513/ using document root <none> and password file <none>
I20260807 19:53:51.832118 14024 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:51.832273 14024 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:51.832589 14024 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:51.835664 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "5b9d0244171849aeb0df8744b0417bc5"
format_stamp: "Formatted at 2026-08-07 19:53:51 on dist-test-slave-2p8l"
server_key: "ba64315647f2428ab39f62f61cdd99f5"
server_key_iv: "3c3a377c82b37a7356989d022f0b413b"
server_key_version: "encryptionkey@0"
I20260807 19:53:51.836467 14024 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "5b9d0244171849aeb0df8744b0417bc5"
format_stamp: "Formatted at 2026-08-07 19:53:51 on dist-test-slave-2p8l"
server_key: "ba64315647f2428ab39f62f61cdd99f5"
server_key_iv: "3c3a377c82b37a7356989d022f0b413b"
server_key_version: "encryptionkey@0"
I20260807 19:53:51.842192 14024 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 19:53:51.845700 14049 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:51.847179 14024 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:53:51.847371 14024 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "5b9d0244171849aeb0df8744b0417bc5"
format_stamp: "Formatted at 2026-08-07 19:53:51 on dist-test-slave-2p8l"
server_key: "ba64315647f2428ab39f62f61cdd99f5"
server_key_iv: "3c3a377c82b37a7356989d022f0b413b"
server_key_version: "encryptionkey@0"
I20260807 19:53:51.847576 14024 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:51.865257 14024 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:51.869477 14024 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:51.869801 14024 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:51.889158 14024 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37613
I20260807 19:53:51.889245 14116 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37613 every 8 connection(s)
I20260807 19:53:51.890570 14024 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:51.894320 14118 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:51.900475 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14024
I20260807 19:53:51.900697 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_1.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:51.901153 12910 external_mini_cluster.cc:1428] Setting key 904e1b7c6dd868a099b548dc36f7b3df
I20260807 19:53:51.905264 14118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5: Bootstrap starting.
I20260807 19:53:51.908809 14118 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:51.910106 14118 log.cc:824] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:51.913445 14118 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5: No bootstrap required, opened a new log
I20260807 19:53:51.915557 14122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:51.902999 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58771 (local address 127.0.0.1:37613)
0807 19:53:51.903869 (+ 870us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:51.903881 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:51.903923 (+ 42us) server_negotiation.cc:407] Connection header received
0807 19:53:51.905712 (+ 1789us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:51.905735 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:51.906174 (+ 439us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:51.906497 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:51.907144 (+ 647us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:51.908430 (+ 1286us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:51.910390 (+ 1960us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:51.911098 (+ 708us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:51.911253 (+ 155us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:51.912625 (+ 1372us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:51.912636 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:51.912654 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:51.913382 (+ 728us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:51.913489 (+ 107us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:51.913525 (+ 36us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:51.913689 (+ 164us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:51.913959 (+ 270us) server_negotiation.cc:299] Negotiation successful
0807 19:53:51.914179 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":654,"thread_start_us":442,"threads_started":1}
I20260807 19:53:51.919703 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:53:51.923417 14118 raft_consensus.cc:348] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b9d0244171849aeb0df8744b0417bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260807 19:53:51.923837 14118 raft_consensus.cc:374] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:51.923982 14118 raft_consensus.cc:729] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5b9d0244171849aeb0df8744b0417bc5, State: Initialized, Role: FOLLOWER
I20260807 19:53:51.924679 14118 consensus_queue.cc:260] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b9d0244171849aeb0df8744b0417bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260807 19:53:51.925096 14118 raft_consensus.cc:388] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:51.925318 14118 raft_consensus.cc:482] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:51.925523 14118 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:51.928009 14118 raft_consensus.cc:504] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b9d0244171849aeb0df8744b0417bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260807 19:53:51.928534 14118 leader_election.cc:302] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 5b9d0244171849aeb0df8744b0417bc5; no voters:
I20260807 19:53:51.929327 14118 leader_election.cc:288] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:51.929457 14132 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:51.930217 14132 raft_consensus.cc:686] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [term 1 LEADER]: Becoming Leader. State: Replica: 5b9d0244171849aeb0df8744b0417bc5, State: Running, Role: LEADER
I20260807 19:53:51.930998 14132 consensus_queue.cc:237] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b9d0244171849aeb0df8744b0417bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } }
I20260807 19:53:51.932024 14122 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:51.925027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50467 (local address 127.0.0.1:37613)
0807 19:53:51.925246 (+ 219us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:51.925252 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:51.925668 (+ 416us) server_negotiation.cc:407] Connection header received
0807 19:53:51.925902 (+ 234us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:51.925906 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:51.925967 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:51.926125 (+ 158us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:51.926659 (+ 534us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:51.927434 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:51.928897 (+ 1463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:51.929453 (+ 556us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:51.929607 (+ 154us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:51.931033 (+ 1426us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:51.931042 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:51.931049 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:51.931076 (+ 27us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:51.931154 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:51.931181 (+ 27us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:51.931321 (+ 140us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:51.931599 (+ 278us) server_negotiation.cc:299] Negotiation successful
0807 19:53:51.931664 (+ 65us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
I20260807 19:53:51.933492 14118 sys_catalog.cc:564] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:51.934384 14134 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 5b9d0244171849aeb0df8744b0417bc5. Latest consensus state: current_term: 1 leader_uuid: "5b9d0244171849aeb0df8744b0417bc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b9d0244171849aeb0df8744b0417bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } } }
I20260807 19:53:51.934868 14134 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:51.936789 14137 sys_catalog.cc:455] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "5b9d0244171849aeb0df8744b0417bc5" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "5b9d0244171849aeb0df8744b0417bc5" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37613 } } }
I20260807 19:53:51.937256 14137 sys_catalog.cc:458] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:51.938026 14142 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:51.944139 14142 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:51.954978 14142 catalog_manager.cc:1347] Generated new cluster ID: 5328b9bde919408b8c93264ae8423d2b
I20260807 19:53:51.955116 14142 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:51.972815 14142 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:51.974172 14142 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:51.982589 14142 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 5b9d0244171849aeb0df8744b0417bc5: Generated new TSK 0
I20260807 19:53:51.983430 14142 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:51.998800 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14024
W20260807 19:53:52.000065 14112 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58771
W20260807 19:53:52.001228 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14024: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:53:52.001454 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14024
W20260807 19:53:52.026412 14001 connection.cc:535] client connection to 127.0.0.1:37613 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:37613): Connection reset by peer (error 104)
2026-08-07T19:53:52Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/1 (2231 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/2
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:52 dist-test-slave-2p8l krb5kdc[14175](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:52 dist-test-slave-2p8l krb5kdc[14175](info): set up 2 sockets
Aug 07 19:53:52 dist-test-slave-2p8l krb5kdc[14175](info): commencing operation
krb5kdc: starting...
W20260807 19:53:53.431543 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.386s user 0.004s sys 0.037s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:53 dist-test-slave-2p8l krb5kdc[14175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132433, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:53Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:53Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:53:53.747205 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35063
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:39357
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:35063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:54.104770 14191 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:54.105069 14191 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:54.105235 14191 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:54.112452 14191 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:54.112607 14191 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:54.112712 14191 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:54.112815 14191 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:54.112879 14191 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:54.122819 14191 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:39357
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:35063
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:35063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:54.124167 14191 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:54.125521 14191 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:54.137823 14200 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:54.137823 14197 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:54.138343 14191 server_base.cc:1034] running on GCE node
W20260807 19:53:54.137912 14198 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:54.139317 14191 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:54.140769 14191 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:54.142048 14191 hybrid_clock.cc:648] HybridClock initialized: now 1786132434141973 us; error 45 us; skew 500 ppm
I20260807 19:53:54.142468 14191 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:54 dist-test-slave-2p8l krb5kdc[14175](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132434, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:54.146386 14191 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:53:54.147883 14191 webserver.cc:460] Webserver started at http://127.0.0.1:41321/ using document root <none> and password file <none>
I20260807 19:53:54.148577 14191 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:54.148730 14191 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:54.149058 14191 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:54.152172 14191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "f53fc0e9f1a24bd0a0927004e28826b9"
format_stamp: "Formatted at 2026-08-07 19:53:54 on dist-test-slave-2p8l"
server_key: "653b462d1bfdf2a0f155f01ea1e7ee87"
server_key_iv: "3e743522296d1ea7e1d23277584a739e"
server_key_version: "encryptionkey@0"
I20260807 19:53:54.152964 14191 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "f53fc0e9f1a24bd0a0927004e28826b9"
format_stamp: "Formatted at 2026-08-07 19:53:54 on dist-test-slave-2p8l"
server_key: "653b462d1bfdf2a0f155f01ea1e7ee87"
server_key_iv: "3e743522296d1ea7e1d23277584a739e"
server_key_version: "encryptionkey@0"
I20260807 19:53:54.158371 14191 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:53:54.162220 14210 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:54.163637 14191 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:54.163847 14191 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "f53fc0e9f1a24bd0a0927004e28826b9"
format_stamp: "Formatted at 2026-08-07 19:53:54 on dist-test-slave-2p8l"
server_key: "653b462d1bfdf2a0f155f01ea1e7ee87"
server_key_iv: "3e743522296d1ea7e1d23277584a739e"
server_key_version: "encryptionkey@0"
I20260807 19:53:54.164068 14191 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:54.171289 14191 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:54.175630 14191 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:54.175938 14191 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:54.195323 14191 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:35063
I20260807 19:53:54.195358 14297 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:35063 every 8 connection(s)
I20260807 19:53:54.196766 14191 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:54.200034 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14191
I20260807 19:53:54.200230 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_2.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:54.200654 14299 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:54.200690 12910 external_mini_cluster.cc:1428] Setting key 4f116c0731d7d88adb7fda348bcdc4ad
I20260807 19:53:54.208951 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:54.202522 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:57617 (local address 127.0.0.1:35063)
0807 19:53:54.203330 (+ 808us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:54.203341 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:54.203384 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:53:54.205442 (+ 2058us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:54.205473 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:54.205808 (+ 335us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:54.206209 (+ 401us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:54.207350 (+ 1141us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:54.207357 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:54.207370 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:54.207384 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:54.207443 (+ 59us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:54.207474 (+ 31us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:54.207726 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:54.207876 (+ 150us) server_negotiation.cc:299] Negotiation successful
0807 19:53:54.208056 (+ 180us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":578,"thread_start_us":362,"threads_started":1}
I20260807 19:53:54.212630 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:53:54.213894 14299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9: Bootstrap starting.
I20260807 19:53:54.217275 14299 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:54.218485 14299 log.cc:824] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:54.220027 14302 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:54.217155 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55145 (local address 127.0.0.1:35063)
0807 19:53:54.217353 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:54.217416 (+ 63us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:54.217826 (+ 410us) server_negotiation.cc:407] Connection header received
0807 19:53:54.218016 (+ 190us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:54.218023 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:54.218138 (+ 115us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:54.218260 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:54.219316 (+ 1056us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:54.219320 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:54.219323 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:54.219338 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:54.219378 (+ 40us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:54.219394 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:54.219486 (+ 92us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:54.219650 (+ 164us) server_negotiation.cc:299] Negotiation successful
0807 19:53:54.219719 (+ 69us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":52}
I20260807 19:53:54.222199 14299 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9: No bootstrap required, opened a new log
I20260807 19:53:54.229518 14299 raft_consensus.cc:348] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35063 } }
I20260807 19:53:54.229913 14299 raft_consensus.cc:374] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:54.230033 14299 raft_consensus.cc:729] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f53fc0e9f1a24bd0a0927004e28826b9, State: Initialized, Role: FOLLOWER
I20260807 19:53:54.230607 14299 consensus_queue.cc:260] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35063 } }
I20260807 19:53:54.230850 14299 raft_consensus.cc:388] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:54.231005 14299 raft_consensus.cc:482] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:54.231207 14299 raft_consensus.cc:3037] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:54.233604 14299 raft_consensus.cc:504] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35063 } }
I20260807 19:53:54.234164 14299 leader_election.cc:302] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: f53fc0e9f1a24bd0a0927004e28826b9; no voters:
I20260807 19:53:54.234791 14299 leader_election.cc:288] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:54.234946 14311 raft_consensus.cc:2781] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:54.235672 14311 raft_consensus.cc:686] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [term 1 LEADER]: Becoming Leader. State: Replica: f53fc0e9f1a24bd0a0927004e28826b9, State: Running, Role: LEADER
I20260807 19:53:54.236250 14311 consensus_queue.cc:237] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35063 } }
I20260807 19:53:54.237193 14299 sys_catalog.cc:564] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:54.239449 14314 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader f53fc0e9f1a24bd0a0927004e28826b9. Latest consensus state: current_term: 1 leader_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35063 } } }
I20260807 19:53:54.239535 14313 sys_catalog.cc:455] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "f53fc0e9f1a24bd0a0927004e28826b9" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 35063 } } }
I20260807 19:53:54.239847 14314 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:54.239933 14313 sys_catalog.cc:458] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:54.243535 14322 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:54.248868 14322 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:54.258574 14322 catalog_manager.cc:1347] Generated new cluster ID: 7ed238c2b43b4a7db07a8a492a81e32e
I20260807 19:53:54.258728 14322 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:54.267338 14322 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:54.267805 14322 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:54.276804 14322 catalog_manager.cc:5868] T 00000000000000000000000000000000 P f53fc0e9f1a24bd0a0927004e28826b9: Generated new TSK 0
I20260807 19:53:54.277807 14322 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:54.288240 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14191
W20260807 19:53:54.289352 14288 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:57617
W20260807 19:53:54.290091 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14191: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:53:54.290246 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14191
2026-08-07T19:53:54Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/2 (2293 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/3
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:54 dist-test-slave-2p8l krb5kdc[14341](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:54 dist-test-slave-2p8l krb5kdc[14341](info): set up 2 sockets
Aug 07 19:53:54 dist-test-slave-2p8l krb5kdc[14341](info): commencing operation
krb5kdc: starting...
W20260807 19:53:55.706918 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.368s user 0.001s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:55 dist-test-slave-2p8l krb5kdc[14341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:55Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:55Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:53:56.019870 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37395
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:34877
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:37395
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:56.360630 14360 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:56.360903 14360 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:56.361074 14360 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:56.368248 14360 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:56.368383 14360 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:56.368474 14360 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:56.368587 14360 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:56.368673 14360 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:56.378464 14360 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:34877
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:37395
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:37395
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:56.379875 14360 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:56.381240 14360 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:56.393082 14368 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:56.393107 14369 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:56.393085 14372 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:56.393986 14360 server_base.cc:1034] running on GCE node
I20260807 19:53:56.394738 14360 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:56.396121 14360 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:56.397349 14360 hybrid_clock.cc:648] HybridClock initialized: now 1786132436397318 us; error 59 us; skew 500 ppm
I20260807 19:53:56.397703 14360 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:56 dist-test-slave-2p8l krb5kdc[14341](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132436, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:56.406821 14360 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:53:56.408932 14360 webserver.cc:460] Webserver started at http://127.0.0.1:45443/ using document root <none> and password file <none>
I20260807 19:53:56.409886 14360 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:56.410081 14360 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:56.410490 14360 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:56.414264 14360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "4e0916c7ff0d4c099114e9a50475fe3e"
format_stamp: "Formatted at 2026-08-07 19:53:56 on dist-test-slave-2p8l"
server_key: "48f5f0b1623dca45e84ece253cce0b49"
server_key_iv: "18437c8e87fa22b776c39e02ae622e2e"
server_key_version: "encryptionkey@0"
I20260807 19:53:56.414991 14360 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "4e0916c7ff0d4c099114e9a50475fe3e"
format_stamp: "Formatted at 2026-08-07 19:53:56 on dist-test-slave-2p8l"
server_key: "48f5f0b1623dca45e84ece253cce0b49"
server_key_iv: "18437c8e87fa22b776c39e02ae622e2e"
server_key_version: "encryptionkey@0"
I20260807 19:53:56.420224 14360 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:53:56.423624 14383 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:56.424937 14360 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.000s sys 0.001s
I20260807 19:53:56.425088 14360 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "4e0916c7ff0d4c099114e9a50475fe3e"
format_stamp: "Formatted at 2026-08-07 19:53:56 on dist-test-slave-2p8l"
server_key: "48f5f0b1623dca45e84ece253cce0b49"
server_key_iv: "18437c8e87fa22b776c39e02ae622e2e"
server_key_version: "encryptionkey@0"
I20260807 19:53:56.425253 14360 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:56.456743 14360 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:56.460845 14360 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:56.461094 14360 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:56.480094 14360 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:37395
I20260807 19:53:56.480130 14466 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:37395 every 8 connection(s)
I20260807 19:53:56.481564 14360 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:56.485404 14468 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:56.490967 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14360
I20260807 19:53:56.491161 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_3.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:56.491719 12910 external_mini_cluster.cc:1428] Setting key 62dfda9b4817e06fc264e40f16e42163
I20260807 19:53:56.496716 14468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e: Bootstrap starting.
I20260807 19:53:56.500512 14468 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:56.501847 14468 log.cc:824] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:56.505398 14468 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e: No bootstrap required, opened a new log
Aug 07 19:53:56 dist-test-slave-2p8l krb5kdc[14341](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132435, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 19:53:56.516084 14468 raft_consensus.cc:348] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37395 } }
I20260807 19:53:56.516595 14468 raft_consensus.cc:374] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:56.516918 14468 raft_consensus.cc:729] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4e0916c7ff0d4c099114e9a50475fe3e, State: Initialized, Role: FOLLOWER
I20260807 19:53:56.517796 14468 consensus_queue.cc:260] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37395 } }
I20260807 19:53:56.518167 14468 raft_consensus.cc:388] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:56.518327 14468 raft_consensus.cc:482] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:56.518528 14468 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:56.518592 14472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:56.493623 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54591 (local address 127.0.0.1:37395)
0807 19:53:56.494586 (+ 963us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:56.494597 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:56.494648 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:53:56.496469 (+ 1821us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:56.496492 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:56.496939 (+ 447us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:56.497278 (+ 339us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:56.499214 (+ 1936us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:56.500661 (+ 1447us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:56.502585 (+ 1924us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:56.503648 (+ 1063us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:56.503794 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:56.508972 (+ 5178us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:56.508983 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:56.509002 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:56.509052 (+ 50us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:56.513377 (+ 4325us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:56.514136 (+ 759us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:56.514146 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:56.514160 (+ 14us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:56.514402 (+ 242us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:56.514783 (+ 381us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:56.514789 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:56.514792 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:56.515608 (+ 816us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:56.515962 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:56.516345 (+ 383us) server_negotiation.cc:299] Negotiation successful
0807 19:53:56.517133 (+ 788us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":735,"thread_start_us":494,"threads_started":1}
I20260807 19:53:56.521086 14468 raft_consensus.cc:504] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37395 } }
I20260807 19:53:56.521806 14468 leader_election.cc:302] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 4e0916c7ff0d4c099114e9a50475fe3e; no voters:
I20260807 19:53:56.522588 14468 leader_election.cc:288] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:56.522678 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:53:56.522704 14474 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:56.524616 14468 sys_catalog.cc:564] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:56.527649 14474 raft_consensus.cc:686] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [term 1 LEADER]: Becoming Leader. State: Replica: 4e0916c7ff0d4c099114e9a50475fe3e, State: Running, Role: LEADER
I20260807 19:53:56.528203 14474 consensus_queue.cc:237] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37395 } }
I20260807 19:53:56.531476 14475 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37395 } } }
I20260807 19:53:56.531378 14476 sys_catalog.cc:455] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 4e0916c7ff0d4c099114e9a50475fe3e. Latest consensus state: current_term: 1 leader_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "4e0916c7ff0d4c099114e9a50475fe3e" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 37395 } } }
I20260807 19:53:56.531770 14475 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:56.531821 14476 sys_catalog.cc:458] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:56.548079 14495 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:56.553319 14495 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:56.563140 14495 catalog_manager.cc:1347] Generated new cluster ID: 72b34d1c4a634df2ba064d17920368ad
I20260807 19:53:56.563267 14495 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:56.564471 14472 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:56.539933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54167 (local address 127.0.0.1:37395)
0807 19:53:56.540156 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:56.540165 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:56.547185 (+ 7020us) server_negotiation.cc:407] Connection header received
0807 19:53:56.547453 (+ 268us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:56.547461 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:56.547580 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:56.547715 (+ 135us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:56.549706 (+ 1991us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:56.550799 (+ 1093us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:56.552598 (+ 1799us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:56.553294 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:56.553444 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:56.556602 (+ 3158us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:56.556609 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:56.556614 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:53:56.556652 (+ 38us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:56.560615 (+ 3963us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:56.561526 (+ 911us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:56.561532 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:56.561535 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:56.561692 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:53:56.562214 (+ 522us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:53:56.562222 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:53:56.562227 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:53:56.562682 (+ 455us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:56.562934 (+ 252us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:56.564035 (+ 1101us) server_negotiation.cc:299] Negotiation successful
0807 19:53:56.564204 (+ 169us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:53:56.585335 14495 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:56.587025 14495 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:56.600026 14495 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 4e0916c7ff0d4c099114e9a50475fe3e: Generated new TSK 0
I20260807 19:53:56.600855 14495 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:56.610894 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14360
I20260807 19:53:56.612864 14459 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:53:56.704097 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14360
2026-08-07T19:53:56Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/3 (2409 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/4
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:56 dist-test-slave-2p8l krb5kdc[14523](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:56 dist-test-slave-2p8l krb5kdc[14523](info): set up 2 sockets
Aug 07 19:53:56 dist-test-slave-2p8l krb5kdc[14523](info): commencing operation
krb5kdc: starting...
W20260807 19:53:58.085366 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.336s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:53:58 dist-test-slave-2p8l krb5kdc[14523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132438, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:53:58Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:53:58Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:53:58.403264 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34121
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:44159
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:34121
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:53:58.754716 14543 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:53:58.755002 14543 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:53:58.755182 14543 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:53:58.762455 14543 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:53:58.762569 14543 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:53:58.762686 14543 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:53:58.762770 14543 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:53:58.762856 14543 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:53:58.772521 14543 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:44159
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:34121
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:34121
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:53:58.773866 14543 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:53:58.775231 14543 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:53:58.787600 14558 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:58.787547 14550 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:53:58.787655 14549 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:53:58.788708 14543 server_base.cc:1034] running on GCE node
I20260807 19:53:58.789522 14543 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:53:58.791030 14543 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:53:58.792274 14543 hybrid_clock.cc:648] HybridClock initialized: now 1786132438792228 us; error 38 us; skew 500 ppm
I20260807 19:53:58.792626 14543 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:53:58 dist-test-slave-2p8l krb5kdc[14523](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132438, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:53:58.795998 14543 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:53:58.797636 14543 webserver.cc:460] Webserver started at http://127.0.0.1:42995/ using document root <none> and password file <none>
I20260807 19:53:58.798395 14543 fs_manager.cc:359] Metadata directory not provided
I20260807 19:53:58.798553 14543 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:53:58.798879 14543 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:53:58.801877 14543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "13634d2c6ac649ec95cbc4a470776ab4"
format_stamp: "Formatted at 2026-08-07 19:53:58 on dist-test-slave-2p8l"
server_key: "5dc49f8accf9f71564f419db693b4de3"
server_key_iv: "02e0e38626267a1ea7e3466f57f19a72"
server_key_version: "encryptionkey@0"
I20260807 19:53:58.802736 14543 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "13634d2c6ac649ec95cbc4a470776ab4"
format_stamp: "Formatted at 2026-08-07 19:53:58 on dist-test-slave-2p8l"
server_key: "5dc49f8accf9f71564f419db693b4de3"
server_key_iv: "02e0e38626267a1ea7e3466f57f19a72"
server_key_version: "encryptionkey@0"
I20260807 19:53:58.807950 14543 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:53:58.811393 14569 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:53:58.812705 14543 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:53:58.812904 14543 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "13634d2c6ac649ec95cbc4a470776ab4"
format_stamp: "Formatted at 2026-08-07 19:53:58 on dist-test-slave-2p8l"
server_key: "5dc49f8accf9f71564f419db693b4de3"
server_key_iv: "02e0e38626267a1ea7e3466f57f19a72"
server_key_version: "encryptionkey@0"
I20260807 19:53:58.813110 14543 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:53:58.829330 14543 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:53:58.833385 14543 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:53:58.833686 14543 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:53:58.853088 14543 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:34121
I20260807 19:53:58.853144 14646 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:34121 every 8 connection(s)
I20260807 19:53:58.854548 14543 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:53:58.858381 14648 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:53:58.862704 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14543
I20260807 19:53:58.862905 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_4.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:53:58.863473 12910 external_mini_cluster.cc:1428] Setting key 77eeb5a0e6d3dd3f4ede33f1431167c9
I20260807 19:53:58.869796 14648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4: Bootstrap starting.
I20260807 19:53:58.873090 14648 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4: Neither blocks nor log segments found. Creating new log.
I20260807 19:53:58.874248 14648 log.cc:824] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4: Log is configured to *not* fsync() on all Append() calls
I20260807 19:53:58.877768 14648 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4: No bootstrap required, opened a new log
I20260807 19:53:58.877974 14651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:58.865382 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58941 (local address 127.0.0.1:34121)
0807 19:53:58.866255 (+ 873us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:58.866266 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:58.866310 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:53:58.868533 (+ 2223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:58.868557 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:58.868943 (+ 386us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:58.869337 (+ 394us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:58.869926 (+ 589us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:58.871405 (+ 1479us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:58.872918 (+ 1513us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:58.873678 (+ 760us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:58.873890 (+ 212us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:58.875289 (+ 1399us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:58.875296 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:58.875310 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:58.875970 (+ 660us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:58.876070 (+ 100us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:58.876103 (+ 33us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:58.876238 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:58.876471 (+ 233us) server_negotiation.cc:299] Negotiation successful
0807 19:53:58.876734 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":594,"thread_start_us":389,"threads_started":1}
I20260807 19:53:58.881701 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:53:58.887791 14648 raft_consensus.cc:348] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13634d2c6ac649ec95cbc4a470776ab4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34121 } }
I20260807 19:53:58.888274 14648 raft_consensus.cc:374] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:53:58.888409 14648 raft_consensus.cc:729] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 13634d2c6ac649ec95cbc4a470776ab4, State: Initialized, Role: FOLLOWER
I20260807 19:53:58.889055 14648 consensus_queue.cc:260] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13634d2c6ac649ec95cbc4a470776ab4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34121 } }
I20260807 19:53:58.889307 14648 raft_consensus.cc:388] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:53:58.889469 14648 raft_consensus.cc:482] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:53:58.889668 14648 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:53:58.891964 14648 raft_consensus.cc:504] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13634d2c6ac649ec95cbc4a470776ab4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34121 } }
I20260807 19:53:58.892516 14648 leader_election.cc:302] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 13634d2c6ac649ec95cbc4a470776ab4; no voters:
I20260807 19:53:58.893285 14648 leader_election.cc:288] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:53:58.893380 14669 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:53:58.893793 14651 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:53:58.887146 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54501 (local address 127.0.0.1:34121)
0807 19:53:58.887375 (+ 229us) server_negotiation.cc:206] Beginning negotiation
0807 19:53:58.887384 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:53:58.887753 (+ 369us) server_negotiation.cc:407] Connection header received
0807 19:53:58.887964 (+ 211us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:53:58.887968 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:53:58.888026 (+ 58us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:53:58.888101 (+ 75us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:53:58.888798 (+ 697us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:58.889727 (+ 929us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:58.891134 (+ 1407us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:53:58.891599 (+ 465us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:53:58.891749 (+ 150us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:53:58.892941 (+ 1192us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:53:58.892951 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:53:58.892954 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:53:58.892971 (+ 17us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:53:58.893012 (+ 41us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:53:58.893028 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:53:58.893130 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 19:53:58.893309 (+ 179us) server_negotiation.cc:299] Negotiation successful
0807 19:53:58.893399 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:53:58.895959 14648 sys_catalog.cc:564] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:53:58.898488 14669 raft_consensus.cc:686] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [term 1 LEADER]: Becoming Leader. State: Replica: 13634d2c6ac649ec95cbc4a470776ab4, State: Running, Role: LEADER
I20260807 19:53:58.899263 14669 consensus_queue.cc:237] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13634d2c6ac649ec95cbc4a470776ab4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34121 } }
I20260807 19:53:58.902411 14670 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "13634d2c6ac649ec95cbc4a470776ab4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13634d2c6ac649ec95cbc4a470776ab4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34121 } } }
I20260807 19:53:58.902784 14670 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:58.903535 14672 sys_catalog.cc:455] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 13634d2c6ac649ec95cbc4a470776ab4. Latest consensus state: current_term: 1 leader_uuid: "13634d2c6ac649ec95cbc4a470776ab4" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "13634d2c6ac649ec95cbc4a470776ab4" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 34121 } } }
I20260807 19:53:58.903992 14672 sys_catalog.cc:458] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4 [sys.catalog]: This master's current role is: LEADER
I20260807 19:53:58.905174 14689 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:53:58.910166 14689 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:53:58.918474 14689 catalog_manager.cc:1347] Generated new cluster ID: 7cae8fb1aa604c4da8205e380d5440a7
I20260807 19:53:58.918583 14689 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:53:58.927827 14689 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:53:58.929028 14689 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:53:58.935724 14689 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 13634d2c6ac649ec95cbc4a470776ab4: Generated new TSK 0
I20260807 19:53:58.936501 14689 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:53:58.948171 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14543
W20260807 19:53:58.949932 14642 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:58941
W20260807 19:53:58.950708 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14543: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:53:58.950870 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14543
2026-08-07T19:53:58Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/4 (2252 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/5
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:53:59 dist-test-slave-2p8l krb5kdc[14698](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:53:59 dist-test-slave-2p8l krb5kdc[14698](info): set up 2 sockets
Aug 07 19:53:59 dist-test-slave-2p8l krb5kdc[14698](info): commencing operation
krb5kdc: starting...
W20260807 19:54:00.357985 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.356s user 0.008s sys 0.033s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:00 dist-test-slave-2p8l krb5kdc[14698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132440, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:00Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:00Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:00.698235 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40933
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42081
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:40933
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:01.068991 14720 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:01.069293 14720 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:01.069389 14720 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:01.076766 14720 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:01.076891 14720 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:01.076941 14720 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:01.076997 14720 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:01.077046 14720 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:01.087203 14720 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42081
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:40933
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:40933
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:01.088548 14720 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:01.089839 14720 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:01.102311 14727 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:01.102444 14728 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:01.102353 14730 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:01.103721 14720 server_base.cc:1034] running on GCE node
I20260807 19:54:01.104549 14720 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:01.106165 14720 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:01.107419 14720 hybrid_clock.cc:648] HybridClock initialized: now 1786132441107377 us; error 33 us; skew 500 ppm
I20260807 19:54:01.107841 14720 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:01 dist-test-slave-2p8l krb5kdc[14698](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132441, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:01.111513 14720 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:01.113116 14720 webserver.cc:460] Webserver started at http://127.0.0.1:40927/ using document root <none> and password file <none>
I20260807 19:54:01.113818 14720 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:01.113929 14720 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:01.114310 14720 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:01.117412 14720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "2648e85695c24c40846c265d00f8b8d0"
format_stamp: "Formatted at 2026-08-07 19:54:01 on dist-test-slave-2p8l"
server_key: "9ea1de593b8b68eedbb7ac2162e58c4f"
server_key_iv: "4441ad8117a91edb307744f04fb54521"
server_key_version: "encryptionkey@0"
I20260807 19:54:01.118280 14720 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "2648e85695c24c40846c265d00f8b8d0"
format_stamp: "Formatted at 2026-08-07 19:54:01 on dist-test-slave-2p8l"
server_key: "9ea1de593b8b68eedbb7ac2162e58c4f"
server_key_iv: "4441ad8117a91edb307744f04fb54521"
server_key_version: "encryptionkey@0"
I20260807 19:54:01.124188 14720 fs_manager.cc:691] Time spent creating directory manager: real 0.006s user 0.005s sys 0.000s
I20260807 19:54:01.127807 14742 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:01.129151 14720 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:54:01.129354 14720 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "2648e85695c24c40846c265d00f8b8d0"
format_stamp: "Formatted at 2026-08-07 19:54:01 on dist-test-slave-2p8l"
server_key: "9ea1de593b8b68eedbb7ac2162e58c4f"
server_key_iv: "4441ad8117a91edb307744f04fb54521"
server_key_version: "encryptionkey@0"
I20260807 19:54:01.129571 14720 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:01.135462 14720 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:01.139526 14720 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:01.139846 14720 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:01.159402 14720 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:40933
I20260807 19:54:01.159446 14828 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:40933 every 8 connection(s)
I20260807 19:54:01.160909 14720 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:01.164009 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14720
I20260807 19:54:01.164211 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_5.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:01.164708 12910 external_mini_cluster.cc:1428] Setting key b48bf47311a142c4f19d860b48cfa665
I20260807 19:54:01.164951 14829 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:01.174011 14839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:01.166562 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51177 (local address 127.0.0.1:40933)
0807 19:54:01.167398 (+ 836us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:01.167413 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:01.167467 (+ 54us) server_negotiation.cc:407] Connection header received
0807 19:54:01.169921 (+ 2454us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:01.169952 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:01.170439 (+ 487us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:01.170925 (+ 486us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:01.171979 (+ 1054us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:01.171987 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:01.172005 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:01.172023 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:01.172094 (+ 71us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:01.172126 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:01.172372 (+ 246us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:01.172513 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 19:54:01.172733 (+ 220us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":595,"thread_start_us":363,"threads_started":1}
I20260807 19:54:01.178158 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:01.180138 14829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0: Bootstrap starting.
I20260807 19:54:01.183811 14829 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:01.185299 14829 log.cc:824] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:01.185572 14839 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:01.182862 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:41929 (local address 127.0.0.1:40933)
0807 19:54:01.183082 (+ 220us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:01.183089 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:01.183419 (+ 330us) server_negotiation.cc:407] Connection header received
0807 19:54:01.183613 (+ 194us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:01.183617 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:01.183667 (+ 50us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:01.183755 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:01.184804 (+ 1049us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:01.184808 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:01.184812 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:01.184826 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:01.184863 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:01.184877 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:01.184970 (+ 93us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:01.185136 (+ 166us) server_negotiation.cc:299] Negotiation successful
0807 19:54:01.185182 (+ 46us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":79}
I20260807 19:54:01.188292 14829 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0: No bootstrap required, opened a new log
I20260807 19:54:01.195858 14829 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2648e85695c24c40846c265d00f8b8d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40933 } }
I20260807 19:54:01.196432 14829 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:01.196580 14829 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2648e85695c24c40846c265d00f8b8d0, State: Initialized, Role: FOLLOWER
I20260807 19:54:01.197327 14829 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2648e85695c24c40846c265d00f8b8d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40933 } }
I20260807 19:54:01.197613 14829 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:01.197778 14829 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:01.197968 14829 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:01.201231 14829 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2648e85695c24c40846c265d00f8b8d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40933 } }
I20260807 19:54:01.201792 14829 leader_election.cc:302] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2648e85695c24c40846c265d00f8b8d0; no voters:
I20260807 19:54:01.205935 14829 leader_election.cc:288] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:01.206086 14849 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:01.207432 14849 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [term 1 LEADER]: Becoming Leader. State: Replica: 2648e85695c24c40846c265d00f8b8d0, State: Running, Role: LEADER
I20260807 19:54:01.208192 14849 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2648e85695c24c40846c265d00f8b8d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40933 } }
I20260807 19:54:01.210041 14829 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:01.211079 14850 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2648e85695c24c40846c265d00f8b8d0. Latest consensus state: current_term: 1 leader_uuid: "2648e85695c24c40846c265d00f8b8d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2648e85695c24c40846c265d00f8b8d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40933 } } }
I20260807 19:54:01.211619 14850 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:01.211184 14852 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2648e85695c24c40846c265d00f8b8d0" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2648e85695c24c40846c265d00f8b8d0" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 40933 } } }
I20260807 19:54:01.213028 14852 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:01.216518 14855 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:01.222101 14855 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:01.232872 14855 catalog_manager.cc:1347] Generated new cluster ID: 20be9dd89a55423cbfc8422c6e8c58d5
I20260807 19:54:01.233016 14855 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:01.260298 14855 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:01.260771 14855 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:01.272691 14855 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2648e85695c24c40846c265d00f8b8d0: Generated new TSK 0
I20260807 19:54:01.273818 14855 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:01.289395 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14720
W20260807 19:54:01.290685 14821 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51177
W20260807 19:54:01.291458 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14720: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:01.291616 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14720
2026-08-07T19:54:01Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/5 (2337 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/6
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:01 dist-test-slave-2p8l krb5kdc[14879](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:01 dist-test-slave-2p8l krb5kdc[14879](info): set up 2 sockets
Aug 07 19:54:01 dist-test-slave-2p8l krb5kdc[14879](info): commencing operation
krb5kdc: starting...
W20260807 19:54:02.670545 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.331s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:02 dist-test-slave-2p8l krb5kdc[14879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:02Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:02Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:03.009548 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39665
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42225
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:39665
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:03.363612 14897 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:03.363981 14897 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:03.364164 14897 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:03.371592 14897 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:03.371747 14897 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:03.371868 14897 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:03.371978 14897 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:03.372066 14897 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:03.382035 14897 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42225
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:39665
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:39665
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:03.383459 14897 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:03.384915 14897 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:03.397456 14904 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:03.397405 14905 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:03.397497 14907 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:03.398388 14897 server_base.cc:1034] running on GCE node
I20260807 19:54:03.399178 14897 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:03.400707 14897 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:03.401962 14897 hybrid_clock.cc:648] HybridClock initialized: now 1786132443401919 us; error 52 us; skew 500 ppm
I20260807 19:54:03.402374 14897 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:03 dist-test-slave-2p8l krb5kdc[14879](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132443, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:03.417680 14897 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:03.419365 14897 webserver.cc:460] Webserver started at http://127.0.0.1:39275/ using document root <none> and password file <none>
I20260807 19:54:03.420074 14897 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:03.420251 14897 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:03.420570 14897 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:03.423768 14897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "895d25943bd5483bb7ae1c7520109b4f"
format_stamp: "Formatted at 2026-08-07 19:54:03 on dist-test-slave-2p8l"
server_key: "bff9664adf78cf6f414cbb7fa2ffdd59"
server_key_iv: "8693aed40512674b056decd580975f9a"
server_key_version: "encryptionkey@0"
I20260807 19:54:03.424547 14897 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "895d25943bd5483bb7ae1c7520109b4f"
format_stamp: "Formatted at 2026-08-07 19:54:03 on dist-test-slave-2p8l"
server_key: "bff9664adf78cf6f414cbb7fa2ffdd59"
server_key_iv: "8693aed40512674b056decd580975f9a"
server_key_version: "encryptionkey@0"
I20260807 19:54:03.429838 14897 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 19:54:03.433557 14922 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:03.434948 14897 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:03.435102 14897 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "895d25943bd5483bb7ae1c7520109b4f"
format_stamp: "Formatted at 2026-08-07 19:54:03 on dist-test-slave-2p8l"
server_key: "bff9664adf78cf6f414cbb7fa2ffdd59"
server_key_iv: "8693aed40512674b056decd580975f9a"
server_key_version: "encryptionkey@0"
I20260807 19:54:03.435271 14897 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:03.447180 14897 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:03.451313 14897 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:03.451552 14897 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:03.471779 14897 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:39665
I20260807 19:54:03.471817 15016 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:39665 every 8 connection(s)
I20260807 19:54:03.473261 14897 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:03.477034 15019 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:03.481663 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 14897
I20260807 19:54:03.481868 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_6.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:03.482395 12910 external_mini_cluster.cc:1428] Setting key 95d34c60f552e5456b66915588d5f773
I20260807 19:54:03.489725 15019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f: Bootstrap starting.
I20260807 19:54:03.493480 15019 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:03.494844 15019 log.cc:824] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:03.497949 15019 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f: No bootstrap required, opened a new log
Aug 07 19:54:03 dist-test-slave-2p8l krb5kdc[14879](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132442, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 19:54:03.508617 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:03.484431 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:54759 (local address 127.0.0.1:39665)
0807 19:54:03.485357 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:03.485377 (+ 20us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:03.485434 (+ 57us) server_negotiation.cc:407] Connection header received
0807 19:54:03.487992 (+ 2558us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:03.488021 (+ 29us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:03.488534 (+ 513us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:03.488971 (+ 437us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:03.490422 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:03.492477 (+ 2055us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:03.493898 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:03.494988 (+ 1090us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:03.495185 (+ 197us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:03.499508 (+ 4323us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:03.499520 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:03.499541 (+ 21us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:03.499595 (+ 54us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:03.503792 (+ 4197us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:03.504615 (+ 823us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:03.504624 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:03.504633 (+ 9us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:03.504874 (+ 241us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:03.505343 (+ 469us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:03.505348 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:03.505352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:03.506087 (+ 735us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:03.506406 (+ 319us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:03.506807 (+ 401us) server_negotiation.cc:299] Negotiation successful
0807 19:54:03.507192 (+ 385us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":636,"thread_start_us":390,"threads_started":1}
I20260807 19:54:03.509234 15019 raft_consensus.cc:348] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "895d25943bd5483bb7ae1c7520109b4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39665 } }
I20260807 19:54:03.509706 15019 raft_consensus.cc:374] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:03.509819 15019 raft_consensus.cc:729] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 895d25943bd5483bb7ae1c7520109b4f, State: Initialized, Role: FOLLOWER
I20260807 19:54:03.510520 15019 consensus_queue.cc:260] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "895d25943bd5483bb7ae1c7520109b4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39665 } }
I20260807 19:54:03.510787 15019 raft_consensus.cc:388] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:03.510950 15019 raft_consensus.cc:482] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:03.511154 15019 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:03.512924 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:03.514120 15019 raft_consensus.cc:504] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "895d25943bd5483bb7ae1c7520109b4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39665 } }
I20260807 19:54:03.514721 15019 leader_election.cc:302] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 895d25943bd5483bb7ae1c7520109b4f; no voters:
I20260807 19:54:03.515378 15019 leader_election.cc:288] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:03.515497 15025 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:03.517984 15019 sys_catalog.cc:564] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:03.524215 15025 raft_consensus.cc:686] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [term 1 LEADER]: Becoming Leader. State: Replica: 895d25943bd5483bb7ae1c7520109b4f, State: Running, Role: LEADER
I20260807 19:54:03.525015 15025 consensus_queue.cc:237] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "895d25943bd5483bb7ae1c7520109b4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39665 } }
I20260807 19:54:03.528554 15026 sys_catalog.cc:455] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "895d25943bd5483bb7ae1c7520109b4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "895d25943bd5483bb7ae1c7520109b4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39665 } } }
I20260807 19:54:03.529109 15026 sys_catalog.cc:458] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:03.528568 15027 sys_catalog.cc:455] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 895d25943bd5483bb7ae1c7520109b4f. Latest consensus state: current_term: 1 leader_uuid: "895d25943bd5483bb7ae1c7520109b4f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "895d25943bd5483bb7ae1c7520109b4f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 39665 } } }
I20260807 19:54:03.529539 15027 sys_catalog.cc:458] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f [sys.catalog]: This master's current role is: LEADER
W20260807 19:54:03.541667 15055 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:54:03.541865 15055 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:54:03.542064 15057 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:03.544234 15057 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:03.554864 15022 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:03.527168 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:33671 (local address 127.0.0.1:39665)
0807 19:54:03.527605 (+ 437us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:03.527612 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:03.538093 (+ 10481us) server_negotiation.cc:407] Connection header received
0807 19:54:03.538338 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:03.538345 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:03.538421 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:03.538536 (+ 115us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:03.540653 (+ 2117us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:03.541953 (+ 1300us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:03.543844 (+ 1891us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:03.544326 (+ 482us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:03.544484 (+ 158us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:03.547667 (+ 3183us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:03.547673 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:03.547677 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:03.547718 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:03.551545 (+ 3827us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:03.552637 (+ 1092us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:03.552645 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:03.552651 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:03.552810 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:03.553303 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:03.553313 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:03.553315 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:03.553632 (+ 317us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:03.553928 (+ 296us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:03.554359 (+ 431us) server_negotiation.cc:299] Negotiation successful
0807 19:54:03.554544 (+ 185us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":295}
I20260807 19:54:03.555397 15057 catalog_manager.cc:1347] Generated new cluster ID: 930d0745e4814b9ca695ee51fb70cd70
I20260807 19:54:03.555505 15057 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:03.581473 15057 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:03.583362 15057 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:03.600453 15057 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 895d25943bd5483bb7ae1c7520109b4f: Generated new TSK 0
I20260807 19:54:03.601588 15057 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:03.613693 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 14897
I20260807 19:54:03.615017 15012 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:03.709229 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 14897
W20260807 19:54:03.734592 14875 connection.cc:535] client connection to 127.0.0.1:39665 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:39665): Connection reset by peer (error 104)
2026-08-07T19:54:03Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/6 (2414 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/7
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:03 dist-test-slave-2p8l krb5kdc[15077](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:03 dist-test-slave-2p8l krb5kdc[15077](info): set up 2 sockets
Aug 07 19:54:03 dist-test-slave-2p8l krb5kdc[15077](info): commencing operation
krb5kdc: starting...
W20260807 19:54:05.173094 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.419s user 0.003s sys 0.040s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:05 dist-test-slave-2p8l krb5kdc[15077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132445, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:05Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:05Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:05.505656 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38411
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:40265
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:38411
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:05.855199 15101 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:05.855595 15101 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:05.855814 15101 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:05.863999 15101 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:05.864116 15101 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:05.864182 15101 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:05.864286 15101 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:05.864382 15101 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:05.875469 15101 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:40265
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:38411
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:38411
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:05.876876 15101 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:05.878364 15101 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:05.891803 15110 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:05.891871 15109 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:05.892529 15113 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:05.893152 15101 server_base.cc:1034] running on GCE node
I20260807 19:54:05.894117 15101 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:05.895715 15101 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:05.896986 15101 hybrid_clock.cc:648] HybridClock initialized: now 1786132445896935 us; error 50 us; skew 500 ppm
I20260807 19:54:05.897416 15101 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:05 dist-test-slave-2p8l krb5kdc[15077](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132445, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:05.900957 15101 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:05.902694 15101 webserver.cc:460] Webserver started at http://127.0.0.1:45253/ using document root <none> and password file <none>
I20260807 19:54:05.903389 15101 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:05.903503 15101 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:05.903784 15101 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:05.907156 15101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "144cf83b867d4532811b5deefdafa75f"
format_stamp: "Formatted at 2026-08-07 19:54:05 on dist-test-slave-2p8l"
server_key: "0c3ca593e3e48772a5634dfb5e4af0df"
server_key_iv: "8774b8b90b67b07d4b100d0514528610"
server_key_version: "encryptionkey@0"
I20260807 19:54:05.907960 15101 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "144cf83b867d4532811b5deefdafa75f"
format_stamp: "Formatted at 2026-08-07 19:54:05 on dist-test-slave-2p8l"
server_key: "0c3ca593e3e48772a5634dfb5e4af0df"
server_key_iv: "8774b8b90b67b07d4b100d0514528610"
server_key_version: "encryptionkey@0"
I20260807 19:54:05.913616 15101 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:54:05.917502 15125 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:05.919497 15101 fs_manager.cc:725] Time spent opening block manager: real 0.004s user 0.003s sys 0.000s
I20260807 19:54:05.919693 15101 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "144cf83b867d4532811b5deefdafa75f"
format_stamp: "Formatted at 2026-08-07 19:54:05 on dist-test-slave-2p8l"
server_key: "0c3ca593e3e48772a5634dfb5e4af0df"
server_key_iv: "8774b8b90b67b07d4b100d0514528610"
server_key_version: "encryptionkey@0"
I20260807 19:54:05.919875 15101 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:05.933542 15101 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:05.937518 15101 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:05.937762 15101 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:05.957018 15101 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:38411
I20260807 19:54:05.957050 15216 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:38411 every 8 connection(s)
I20260807 19:54:05.958518 15101 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:05.962308 15217 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:05.967913 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15101
I20260807 19:54:05.968111 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_7.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:05.968703 12910 external_mini_cluster.cc:1428] Setting key 26168fb9c9cead588f4967d17460daf5
I20260807 19:54:05.973886 15217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f: Bootstrap starting.
I20260807 19:54:05.976990 15217 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:05.978040 15217 log.cc:824] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:05.981137 15217 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f: No bootstrap required, opened a new log
I20260807 19:54:05.981978 15222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:05.970685 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:46807 (local address 127.0.0.1:38411)
0807 19:54:05.971588 (+ 903us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:05.971600 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:05.971648 (+ 48us) server_negotiation.cc:407] Connection header received
0807 19:54:05.973356 (+ 1708us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:05.973380 (+ 24us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:05.973760 (+ 380us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:05.974169 (+ 409us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:05.974722 (+ 553us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:05.976035 (+ 1313us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:05.977460 (+ 1425us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:05.978218 (+ 758us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:05.978422 (+ 204us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:05.979758 (+ 1336us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:05.979766 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:05.979780 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:05.980305 (+ 525us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:05.980380 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:05.980406 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:05.980582 (+ 176us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:05.980873 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:54:05.981033 (+ 160us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":667,"thread_start_us":424,"threads_started":1}
I20260807 19:54:05.985976 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:05.989699 15217 raft_consensus.cc:348] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "144cf83b867d4532811b5deefdafa75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38411 } }
I20260807 19:54:05.990116 15217 raft_consensus.cc:374] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:05.990257 15217 raft_consensus.cc:729] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 144cf83b867d4532811b5deefdafa75f, State: Initialized, Role: FOLLOWER
I20260807 19:54:05.991036 15217 consensus_queue.cc:260] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "144cf83b867d4532811b5deefdafa75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38411 } }
I20260807 19:54:05.991372 15217 raft_consensus.cc:388] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:05.991549 15217 raft_consensus.cc:482] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:05.991799 15217 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:05.994943 15217 raft_consensus.cc:504] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "144cf83b867d4532811b5deefdafa75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38411 } }
I20260807 19:54:05.995595 15217 leader_election.cc:302] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 144cf83b867d4532811b5deefdafa75f; no voters:
I20260807 19:54:05.996320 15217 leader_election.cc:288] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:05.996411 15244 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:05.998396 15222 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:05.990629 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:52183 (local address 127.0.0.1:38411)
0807 19:54:05.990856 (+ 227us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:05.990865 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:05.991275 (+ 410us) server_negotiation.cc:407] Connection header received
0807 19:54:05.991502 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:05.991509 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:05.991587 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:05.991698 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:05.992413 (+ 715us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:05.993257 (+ 844us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:05.995237 (+ 1980us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:05.995695 (+ 458us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:05.995844 (+ 149us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:05.997277 (+ 1433us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:05.997283 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:05.997287 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:05.997307 (+ 20us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:05.997373 (+ 66us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:05.997398 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:05.997535 (+ 137us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:05.997834 (+ 299us) server_negotiation.cc:299] Negotiation successful
0807 19:54:05.998127 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:54:05.999326 15217 sys_catalog.cc:564] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:06.003420 15244 raft_consensus.cc:686] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [term 1 LEADER]: Becoming Leader. State: Replica: 144cf83b867d4532811b5deefdafa75f, State: Running, Role: LEADER
I20260807 19:54:06.004220 15244 consensus_queue.cc:237] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "144cf83b867d4532811b5deefdafa75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38411 } }
I20260807 19:54:06.013336 15246 sys_catalog.cc:455] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "144cf83b867d4532811b5deefdafa75f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "144cf83b867d4532811b5deefdafa75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38411 } } }
I20260807 19:54:06.013226 15247 sys_catalog.cc:455] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 144cf83b867d4532811b5deefdafa75f. Latest consensus state: current_term: 1 leader_uuid: "144cf83b867d4532811b5deefdafa75f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "144cf83b867d4532811b5deefdafa75f" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 38411 } } }
I20260807 19:54:06.013742 15246 sys_catalog.cc:458] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:06.015951 15247 sys_catalog.cc:458] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f [sys.catalog]: This master's current role is: LEADER
W20260807 19:54:06.019541 15272 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:54:06.019683 15272 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:54:06.019858 15270 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:06.021728 15270 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:06.031056 15270 catalog_manager.cc:1347] Generated new cluster ID: 20125ea9ca764951acb1c92df747857e
I20260807 19:54:06.031222 15270 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:06.056237 15270 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:06.058157 15270 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:06.074623 15270 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 144cf83b867d4532811b5deefdafa75f: Generated new TSK 0
I20260807 19:54:06.075682 15270 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:06.089984 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15101
W20260807 19:54:06.091394 15210 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.168:46807
W20260807 19:54:06.092196 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15101: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:06.092542 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15101
W20260807 19:54:06.124085 15071 connection.cc:535] client connection to 127.0.0.1:38411 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:38411): Connection reset by peer (error 104)
2026-08-07T19:54:06Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/7 (2389 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/8
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:06 dist-test-slave-2p8l krb5kdc[15279](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:06 dist-test-slave-2p8l krb5kdc[15279](info): set up 2 sockets
Aug 07 19:54:06 dist-test-slave-2p8l krb5kdc[15279](info): commencing operation
krb5kdc: starting...
W20260807 19:54:07.525707 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.382s user 0.001s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:07 dist-test-slave-2p8l krb5kdc[15279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132447, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:07Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:07Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:07.853163 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45969
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:41641
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:45969
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:08.200146 15302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:08.200508 15302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:08.200676 15302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:08.208057 15302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:08.208205 15302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:08.208321 15302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:08.208433 15302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:08.208525 15302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:08.218559 15302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:41641
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:45969
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:45969
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:08.219914 15302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:08.221316 15302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:08.234117 15311 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:08.234834 15313 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:08.234861 15310 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:08.236295 15302 server_base.cc:1034] running on GCE node
I20260807 19:54:08.237164 15302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:08.238694 15302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:08.239933 15302 hybrid_clock.cc:648] HybridClock initialized: now 1786132448239892 us; error 58 us; skew 500 ppm
I20260807 19:54:08.240304 15302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:08 dist-test-slave-2p8l krb5kdc[15279](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132448, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:08.243659 15302 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:08.245218 15302 webserver.cc:460] Webserver started at http://127.0.0.1:39033/ using document root <none> and password file <none>
I20260807 19:54:08.245914 15302 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:08.246133 15302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:08.246456 15302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:08.249480 15302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "d894d25396ab45be801ef56b373c6ad2"
format_stamp: "Formatted at 2026-08-07 19:54:08 on dist-test-slave-2p8l"
server_key: "9d15c9d7e7782f45efaa16f81f02d5d1"
server_key_iv: "5c1f4136c018318fe167242b3fdb39ab"
server_key_version: "encryptionkey@0"
I20260807 19:54:08.250339 15302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "d894d25396ab45be801ef56b373c6ad2"
format_stamp: "Formatted at 2026-08-07 19:54:08 on dist-test-slave-2p8l"
server_key: "9d15c9d7e7782f45efaa16f81f02d5d1"
server_key_iv: "5c1f4136c018318fe167242b3fdb39ab"
server_key_version: "encryptionkey@0"
I20260807 19:54:08.255484 15302 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.004s
I20260807 19:54:08.259079 15322 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:08.260377 15302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:54:08.260571 15302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "d894d25396ab45be801ef56b373c6ad2"
format_stamp: "Formatted at 2026-08-07 19:54:08 on dist-test-slave-2p8l"
server_key: "9d15c9d7e7782f45efaa16f81f02d5d1"
server_key_iv: "5c1f4136c018318fe167242b3fdb39ab"
server_key_version: "encryptionkey@0"
I20260807 19:54:08.260778 15302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:08.266804 15302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:08.271217 15302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:08.271566 15302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:08.290870 15302 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:45969
I20260807 19:54:08.290963 15404 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:45969 every 8 connection(s)
I20260807 19:54:08.292280 15302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:08.295928 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15302
I20260807 19:54:08.296084 15405 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:08.296123 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_8.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:08.296602 12910 external_mini_cluster.cc:1428] Setting key b73fe3fdcd52056fc5803cd23528fffb
I20260807 19:54:08.304440 15413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:08.298458 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:54641 (local address 127.0.0.1:45969)
0807 19:54:08.299365 (+ 907us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:08.299377 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:08.299422 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:54:08.301074 (+ 1652us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:08.301096 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:08.301425 (+ 329us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:08.301756 (+ 331us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:08.302907 (+ 1151us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:08.302913 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:08.302926 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:08.302941 (+ 15us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:08.302999 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:08.303020 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:08.303213 (+ 193us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:08.303316 (+ 103us) server_negotiation.cc:299] Negotiation successful
0807 19:54:08.303531 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":683,"thread_start_us":421,"threads_started":1}
I20260807 19:54:08.308300 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:08.309916 15405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2: Bootstrap starting.
I20260807 19:54:08.313217 15405 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:08.314531 15405 log.cc:824] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:08.315677 15413 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:08.312816 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:49775 (local address 127.0.0.1:45969)
0807 19:54:08.312996 (+ 180us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:08.313003 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:08.313531 (+ 528us) server_negotiation.cc:407] Connection header received
0807 19:54:08.313676 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:08.313684 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:08.313758 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:08.313864 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:08.314874 (+ 1010us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:08.314881 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:08.314887 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:08.314905 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:08.314950 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:08.314976 (+ 26us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:08.315136 (+ 160us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:08.315289 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 19:54:08.315339 (+ 50us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":63}
I20260807 19:54:08.317592 15405 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2: No bootstrap required, opened a new log
I20260807 19:54:08.325209 15405 raft_consensus.cc:348] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d894d25396ab45be801ef56b373c6ad2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45969 } }
I20260807 19:54:08.325569 15405 raft_consensus.cc:374] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:08.325688 15405 raft_consensus.cc:729] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: d894d25396ab45be801ef56b373c6ad2, State: Initialized, Role: FOLLOWER
I20260807 19:54:08.326324 15405 consensus_queue.cc:260] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d894d25396ab45be801ef56b373c6ad2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45969 } }
I20260807 19:54:08.326597 15405 raft_consensus.cc:388] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:08.326766 15405 raft_consensus.cc:482] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:08.326949 15405 raft_consensus.cc:3037] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:08.335249 15405 raft_consensus.cc:504] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d894d25396ab45be801ef56b373c6ad2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45969 } }
I20260807 19:54:08.335894 15405 leader_election.cc:302] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: d894d25396ab45be801ef56b373c6ad2; no voters:
I20260807 19:54:08.336724 15405 leader_election.cc:288] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:08.336846 15429 raft_consensus.cc:2781] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:08.339629 15405 sys_catalog.cc:564] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:08.345522 15429 raft_consensus.cc:686] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [term 1 LEADER]: Becoming Leader. State: Replica: d894d25396ab45be801ef56b373c6ad2, State: Running, Role: LEADER
I20260807 19:54:08.346139 15429 consensus_queue.cc:237] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d894d25396ab45be801ef56b373c6ad2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45969 } }
I20260807 19:54:08.348664 15430 sys_catalog.cc:455] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "d894d25396ab45be801ef56b373c6ad2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d894d25396ab45be801ef56b373c6ad2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45969 } } }
I20260807 19:54:08.348927 15431 sys_catalog.cc:455] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [sys.catalog]: SysCatalogTable state changed. Reason: New leader d894d25396ab45be801ef56b373c6ad2. Latest consensus state: current_term: 1 leader_uuid: "d894d25396ab45be801ef56b373c6ad2" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "d894d25396ab45be801ef56b373c6ad2" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 45969 } } }
I20260807 19:54:08.349295 15430 sys_catalog.cc:458] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:08.349536 15431 sys_catalog.cc:458] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:08.350793 15445 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:08.362167 15445 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:08.397127 15445 catalog_manager.cc:1347] Generated new cluster ID: 07c1a7938f7f4bc8a283f085f082ad07
I20260807 19:54:08.397260 15445 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:08.418771 15445 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:08.419266 15445 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:08.441093 15445 catalog_manager.cc:5868] T 00000000000000000000000000000000 P d894d25396ab45be801ef56b373c6ad2: Generated new TSK 0
I20260807 19:54:08.442211 15445 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:08.462749 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15302
W20260807 19:54:08.464514 15395 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.168:54641
W20260807 19:54:08.465375 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15302: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:08.465560 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15302
2026-08-07T19:54:08Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/8 (2367 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/9
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:08 dist-test-slave-2p8l krb5kdc[15463](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:08 dist-test-slave-2p8l krb5kdc[15463](info): set up 2 sockets
Aug 07 19:54:08 dist-test-slave-2p8l krb5kdc[15463](info): commencing operation
krb5kdc: starting...
W20260807 19:54:09.822003 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.311s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:10 dist-test-slave-2p8l krb5kdc[15463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:10Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:10Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:10.149587 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33473
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:43657
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:33473
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:10.497118 15488 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:10.497468 15488 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:10.497656 15488 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:10.504984 15488 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:10.505146 15488 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:10.505259 15488 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:10.505379 15488 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:10.505460 15488 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:10.515396 15488 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:43657
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:33473
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:33473
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:10.516811 15488 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:10.518245 15488 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:10.530671 15495 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:10.530746 15499 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:10.530823 15496 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:10.532325 15488 server_base.cc:1034] running on GCE node
I20260807 19:54:10.533169 15488 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:10.534744 15488 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:10.536011 15488 hybrid_clock.cc:648] HybridClock initialized: now 1786132450535963 us; error 58 us; skew 500 ppm
I20260807 19:54:10.536403 15488 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:10 dist-test-slave-2p8l krb5kdc[15463](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132450, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:10.539825 15488 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:10.541503 15488 webserver.cc:460] Webserver started at http://127.0.0.1:40343/ using document root <none> and password file <none>
I20260807 19:54:10.542306 15488 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:10.542470 15488 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:10.542805 15488 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:10.545882 15488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "742b10ba037d4198888ba853f1336031"
format_stamp: "Formatted at 2026-08-07 19:54:10 on dist-test-slave-2p8l"
server_key: "8021cd4d9d375cd288832486914f9abd"
server_key_iv: "64831a7e46c162e1899bc031ce499f4a"
server_key_version: "encryptionkey@0"
I20260807 19:54:10.546752 15488 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "742b10ba037d4198888ba853f1336031"
format_stamp: "Formatted at 2026-08-07 19:54:10 on dist-test-slave-2p8l"
server_key: "8021cd4d9d375cd288832486914f9abd"
server_key_iv: "64831a7e46c162e1899bc031ce499f4a"
server_key_version: "encryptionkey@0"
I20260807 19:54:10.551883 15488 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:54:10.555446 15510 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:10.556778 15488 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:54:10.556967 15488 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "742b10ba037d4198888ba853f1336031"
format_stamp: "Formatted at 2026-08-07 19:54:10 on dist-test-slave-2p8l"
server_key: "8021cd4d9d375cd288832486914f9abd"
server_key_iv: "64831a7e46c162e1899bc031ce499f4a"
server_key_version: "encryptionkey@0"
I20260807 19:54:10.557164 15488 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:10.574265 15488 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:10.578410 15488 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:10.578720 15488 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:10.598265 15488 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:33473
I20260807 19:54:10.598241 15591 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:33473 every 8 connection(s)
I20260807 19:54:10.599701 15488 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:10.601500 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15488
I20260807 19:54:10.601724 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_9.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:10.602249 12910 external_mini_cluster.cc:1428] Setting key aa0be767b71d76f8a2a90eacbb65b097
I20260807 19:54:10.603821 15594 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:54:10 dist-test-slave-2p8l krb5kdc[15463](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132450, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.0.0.1@KRBTEST.COM
I20260807 19:54:10.617934 15594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031: Bootstrap starting.
I20260807 19:54:10.622241 15594 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:10.623525 15594 log.cc:824] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:10.627180 15594 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031: No bootstrap required, opened a new log
I20260807 19:54:10.627750 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:10.604108 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:38591 (local address 127.0.0.1:33473)
0807 19:54:10.604942 (+ 834us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:10.604957 (+ 15us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:10.605021 (+ 64us) server_negotiation.cc:407] Connection header received
0807 19:54:10.607244 (+ 2223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:10.607274 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:10.607834 (+ 560us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:10.608291 (+ 457us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:10.609618 (+ 1327us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:10.611747 (+ 2129us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:10.612970 (+ 1223us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:10.614013 (+ 1043us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:10.614256 (+ 243us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:10.618718 (+ 4462us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:10.618730 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:10.618748 (+ 18us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:10.618808 (+ 60us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:10.622918 (+ 4110us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:10.623737 (+ 819us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:10.623745 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:10.623753 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:10.623952 (+ 199us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:10.624561 (+ 609us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:10.624564 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:10.624566 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:10.625204 (+ 638us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:10.625527 (+ 323us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:10.625983 (+ 456us) server_negotiation.cc:299] Negotiation successful
0807 19:54:10.626361 (+ 378us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":580,"thread_start_us":345,"threads_started":1}
I20260807 19:54:10.631774 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:10.636061 15594 raft_consensus.cc:348] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742b10ba037d4198888ba853f1336031" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260807 19:54:10.636528 15594 raft_consensus.cc:374] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:10.636643 15594 raft_consensus.cc:729] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 742b10ba037d4198888ba853f1336031, State: Initialized, Role: FOLLOWER
I20260807 19:54:10.637251 15594 consensus_queue.cc:260] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742b10ba037d4198888ba853f1336031" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260807 19:54:10.637512 15594 raft_consensus.cc:388] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:10.637676 15594 raft_consensus.cc:482] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:10.637854 15594 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:10.640164 15594 raft_consensus.cc:504] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742b10ba037d4198888ba853f1336031" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260807 19:54:10.640668 15594 leader_election.cc:302] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 742b10ba037d4198888ba853f1336031; no voters:
I20260807 19:54:10.641358 15594 leader_election.cc:288] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:10.641484 15611 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:10.642894 15611 raft_consensus.cc:686] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [term 1 LEADER]: Becoming Leader. State: Replica: 742b10ba037d4198888ba853f1336031, State: Running, Role: LEADER
I20260807 19:54:10.643797 15594 sys_catalog.cc:564] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:10.643796 15611 consensus_queue.cc:237] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742b10ba037d4198888ba853f1336031" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } }
I20260807 19:54:10.646600 15615 sys_catalog.cc:455] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 742b10ba037d4198888ba853f1336031. Latest consensus state: current_term: 1 leader_uuid: "742b10ba037d4198888ba853f1336031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742b10ba037d4198888ba853f1336031" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } } }
I20260807 19:54:10.646991 15615 sys_catalog.cc:458] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:10.647665 15614 sys_catalog.cc:455] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "742b10ba037d4198888ba853f1336031" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "742b10ba037d4198888ba853f1336031" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 33473 } } }
I20260807 19:54:10.647972 15614 sys_catalog.cc:458] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:10.655448 15624 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:10.656563 15597 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:10.636288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:55193 (local address 127.0.0.1:33473)
0807 19:54:10.636488 (+ 200us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:10.636493 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:10.637062 (+ 569us) server_negotiation.cc:407] Connection header received
0807 19:54:10.637278 (+ 216us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:10.637282 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:10.637342 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:10.637450 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:10.639085 (+ 1635us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:10.639860 (+ 775us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:10.641318 (+ 1458us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:10.642201 (+ 883us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:10.642329 (+ 128us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:10.645849 (+ 3520us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:10.645859 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:10.645866 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:10.645922 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:10.651294 (+ 5372us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:10.652666 (+ 1372us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:10.652674 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:10.652680 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:10.652981 (+ 301us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:10.653742 (+ 761us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:10.653750 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:10.653756 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:10.654276 (+ 520us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:10.655446 (+ 1170us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:10.655775 (+ 329us) server_negotiation.cc:299] Negotiation successful
0807 19:54:10.656027 (+ 252us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:54:10.662220 15624 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:10.671375 15624 catalog_manager.cc:1347] Generated new cluster ID: c3e350d5ad644be9ae27d6b7c67d8fe9
I20260807 19:54:10.671504 15624 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:10.694593 15624 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:10.695909 15624 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:10.705004 15624 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 742b10ba037d4198888ba853f1336031: Generated new TSK 0
I20260807 19:54:10.705900 15624 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:10.714112 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15488
I20260807 19:54:10.715341 15584 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:10.807837 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15488
W20260807 19:54:10.828841 15460 connection.cc:535] client connection to 127.0.0.1:33473 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:33473): Connection reset by peer (error 104)
2026-08-07T19:54:10Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/9 (2336 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/10
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:10 dist-test-slave-2p8l krb5kdc[15654](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:10 dist-test-slave-2p8l krb5kdc[15654](info): set up 2 sockets
Aug 07 19:54:10 dist-test-slave-2p8l krb5kdc[15654](info): commencing operation
krb5kdc: starting...
W20260807 19:54:12.178846 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.330s user 0.002s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:12 dist-test-slave-2p8l krb5kdc[15654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132452, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:12Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:12Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:12.503600 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44033
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:42111
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:44033
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:12.858157 15677 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:12.858530 15677 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:12.858704 15677 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:12.866144 15677 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:12.866317 15677 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:12.866413 15677 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:12.866533 15677 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:12.866621 15677 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:12.876998 15677 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:42111
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:44033
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:44033
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:12.878497 15677 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:12.879844 15677 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:12.892328 15692 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:12.892364 15687 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:12.892405 15684 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:12.893301 15677 server_base.cc:1034] running on GCE node
I20260807 19:54:12.894145 15677 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:12.895613 15677 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:12.896827 15677 hybrid_clock.cc:648] HybridClock initialized: now 1786132452896776 us; error 43 us; skew 500 ppm
I20260807 19:54:12.897204 15677 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:12 dist-test-slave-2p8l krb5kdc[15654](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132452, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:12.900568 15677 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:12.902387 15677 webserver.cc:460] Webserver started at http://127.0.0.1:46297/ using document root <none> and password file <none>
I20260807 19:54:12.903127 15677 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:12.903294 15677 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:12.903630 15677 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:12.906884 15677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "232307d1bfbd47d69fdbc67001d0ea84"
format_stamp: "Formatted at 2026-08-07 19:54:12 on dist-test-slave-2p8l"
server_key: "a292e399d7844b41d4a01c1ef393f842"
server_key_iv: "be1b2773b74d49ddc8dc9fea1796c2f3"
server_key_version: "encryptionkey@0"
I20260807 19:54:12.907711 15677 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "232307d1bfbd47d69fdbc67001d0ea84"
format_stamp: "Formatted at 2026-08-07 19:54:12 on dist-test-slave-2p8l"
server_key: "a292e399d7844b41d4a01c1ef393f842"
server_key_iv: "be1b2773b74d49ddc8dc9fea1796c2f3"
server_key_version: "encryptionkey@0"
I20260807 19:54:12.913349 15677 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:54:12.917184 15702 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:12.918678 15677 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 19:54:12.918902 15677 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "232307d1bfbd47d69fdbc67001d0ea84"
format_stamp: "Formatted at 2026-08-07 19:54:12 on dist-test-slave-2p8l"
server_key: "a292e399d7844b41d4a01c1ef393f842"
server_key_iv: "be1b2773b74d49ddc8dc9fea1796c2f3"
server_key_version: "encryptionkey@0"
I20260807 19:54:12.919118 15677 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:12.941249 15677 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:12.945863 15677 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:12.946233 15677 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:12.968225 15677 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:44033
I20260807 19:54:12.968277 15784 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:44033 every 8 connection(s)
I20260807 19:54:12.969802 15677 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:12.973860 15785 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:12.976738 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15677
I20260807 19:54:12.976950 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_10.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:12.977397 12910 external_mini_cluster.cc:1428] Setting key 88b8c9b3fdae616bfe8a3634d9b9d268
I20260807 19:54:12.987249 15785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84: Bootstrap starting.
I20260807 19:54:12.991333 15785 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:12.991820 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:12.979476 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:40905 (local address 127.0.0.1:44033)
0807 19:54:12.980340 (+ 864us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:12.980351 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:12.980395 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:54:12.982043 (+ 1648us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:12.982127 (+ 84us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:12.982535 (+ 408us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:12.982858 (+ 323us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:12.983524 (+ 666us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:12.984899 (+ 1375us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:12.987030 (+ 2131us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:12.987778 (+ 748us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:12.987908 (+ 130us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:12.989365 (+ 1457us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:12.989372 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:12.989385 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:12.989912 (+ 527us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:12.989991 (+ 79us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:12.990016 (+ 25us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:12.990219 (+ 203us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:12.990510 (+ 291us) server_negotiation.cc:299] Negotiation successful
0807 19:54:12.990709 (+ 199us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":635,"thread_start_us":402,"threads_started":1}
I20260807 19:54:12.992579 15785 log.cc:824] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:12.995740 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:12.995903 15785 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84: No bootstrap required, opened a new log
I20260807 19:54:13.004534 15785 raft_consensus.cc:348] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232307d1bfbd47d69fdbc67001d0ea84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44033 } }
I20260807 19:54:13.004997 15785 raft_consensus.cc:374] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:13.005165 15785 raft_consensus.cc:729] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 232307d1bfbd47d69fdbc67001d0ea84, State: Initialized, Role: FOLLOWER
I20260807 19:54:13.005906 15785 consensus_queue.cc:260] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232307d1bfbd47d69fdbc67001d0ea84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44033 } }
I20260807 19:54:13.006291 15785 raft_consensus.cc:388] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:13.006491 15785 raft_consensus.cc:482] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:13.006711 15785 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:13.007191 15788 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:13.000478 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:52543 (local address 127.0.0.1:44033)
0807 19:54:13.000717 (+ 239us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:13.000727 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:13.001201 (+ 474us) server_negotiation.cc:407] Connection header received
0807 19:54:13.001438 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:13.001442 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:13.001506 (+ 64us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:13.001630 (+ 124us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:13.002224 (+ 594us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:13.003006 (+ 782us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:13.004336 (+ 1330us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:13.004795 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:13.004934 (+ 139us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:13.006300 (+ 1366us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:13.006305 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:13.006308 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:13.006327 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:13.006402 (+ 75us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:13.006418 (+ 16us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:13.006581 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:13.006786 (+ 205us) server_negotiation.cc:299] Negotiation successful
0807 19:54:13.006840 (+ 54us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:54:13.009526 15785 raft_consensus.cc:504] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232307d1bfbd47d69fdbc67001d0ea84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44033 } }
I20260807 19:54:13.010160 15785 leader_election.cc:302] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 232307d1bfbd47d69fdbc67001d0ea84; no voters:
I20260807 19:54:13.010774 15785 leader_election.cc:288] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:13.010905 15799 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:13.013156 15785 sys_catalog.cc:564] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:13.013589 15799 raft_consensus.cc:686] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [term 1 LEADER]: Becoming Leader. State: Replica: 232307d1bfbd47d69fdbc67001d0ea84, State: Running, Role: LEADER
I20260807 19:54:13.014196 15799 consensus_queue.cc:237] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232307d1bfbd47d69fdbc67001d0ea84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44033 } }
I20260807 19:54:13.017904 15800 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "232307d1bfbd47d69fdbc67001d0ea84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232307d1bfbd47d69fdbc67001d0ea84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44033 } } }
I20260807 19:54:13.018316 15801 sys_catalog.cc:455] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 232307d1bfbd47d69fdbc67001d0ea84. Latest consensus state: current_term: 1 leader_uuid: "232307d1bfbd47d69fdbc67001d0ea84" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "232307d1bfbd47d69fdbc67001d0ea84" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 44033 } } }
I20260807 19:54:13.018567 15800 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:13.018625 15801 sys_catalog.cc:458] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:13.020666 15820 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:13.026518 15820 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:13.035863 15820 catalog_manager.cc:1347] Generated new cluster ID: 697b4c31ff77400d877c290675d25c5b
I20260807 19:54:13.035998 15820 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:13.062307 15820 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:13.064368 15820 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:13.073159 15820 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 232307d1bfbd47d69fdbc67001d0ea84: Generated new TSK 0
I20260807 19:54:13.074034 15820 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:13.091975 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15677
W20260807 19:54:13.094465 15778 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.168:40905
W20260807 19:54:13.095273 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15677: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:13.095438 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15677
W20260807 19:54:13.120846 15650 connection.cc:535] client connection to 127.0.0.1:44033 recv error: Network error: failed to read from TLS socket (remote: 127.0.0.1:44033): Connection reset by peer (error 104)
2026-08-07T19:54:13Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/10 (2291 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/11
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:13 dist-test-slave-2p8l krb5kdc[15838](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:13 dist-test-slave-2p8l krb5kdc[15838](info): set up 2 sockets
Aug 07 19:54:13 dist-test-slave-2p8l krb5kdc[15838](info): commencing operation
krb5kdc: starting...
W20260807 19:54:14.452101 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.312s user 0.001s sys 0.042s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:14 dist-test-slave-2p8l krb5kdc[15838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132454, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:14Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:14Z Disabled control of system clock
WARNING: no policy specified for kudu/127.0.0.1@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.0.0.1@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
Entry for principal kudu/127.0.0.1 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab.
I20260807 19:54:14.777606 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32905
--webserver_interface=127.0.0.1
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.0.0.1:38885
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.0.0.1:32905
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:15.128695 15862 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:15.129009 15862 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:15.129146 15862 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:15.136261 15862 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:15.136371 15862 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:15.136487 15862 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:15.136606 15862 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:15.136686 15862 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:15.146533 15862 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.0.0.1:38885
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.0.0.1:32905
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/krb5kdc/kudu_127.0.0.1.keytab
--principal=kudu/127.0.0.1
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.0.0.1:32905
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.0.0.1
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:15.147869 15862 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:15.149168 15862 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:15.161093 15870 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:15.161145 15875 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:15.161175 15871 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:15.162403 15862 server_base.cc:1034] running on GCE node
I20260807 19:54:15.163178 15862 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:15.164535 15862 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:15.165771 15862 hybrid_clock.cc:648] HybridClock initialized: now 1786132455165716 us; error 43 us; skew 500 ppm
I20260807 19:54:15.166195 15862 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:15 dist-test-slave-2p8l krb5kdc[15838](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132455, etypes {rep=17 tkt=17 ses=17}, kudu/127.0.0.1@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:15.172959 15862 init.cc:377] Logged in from keytab as kudu/127.0.0.1@KRBTEST.COM (short username kudu)
I20260807 19:54:15.174553 15862 webserver.cc:460] Webserver started at http://127.0.0.1:36985/ using document root <none> and password file <none>
I20260807 19:54:15.175259 15862 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:15.175411 15862 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:15.175726 15862 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:15.178785 15862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "158b74df55c04cee947706b2e3423e24"
format_stamp: "Formatted at 2026-08-07 19:54:15 on dist-test-slave-2p8l"
server_key: "4e6de9a193dfc3c6637672e9f30f472f"
server_key_iv: "23576146c75df34c7af683de163d6e65"
server_key_version: "encryptionkey@0"
I20260807 19:54:15.179553 15862 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "158b74df55c04cee947706b2e3423e24"
format_stamp: "Formatted at 2026-08-07 19:54:15 on dist-test-slave-2p8l"
server_key: "4e6de9a193dfc3c6637672e9f30f472f"
server_key_iv: "23576146c75df34c7af683de163d6e65"
server_key_version: "encryptionkey@0"
I20260807 19:54:15.184648 15862 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.001s
I20260807 19:54:15.187990 15888 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:15.189296 15862 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.000s
I20260807 19:54:15.189486 15862 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "158b74df55c04cee947706b2e3423e24"
format_stamp: "Formatted at 2026-08-07 19:54:15 on dist-test-slave-2p8l"
server_key: "4e6de9a193dfc3c6637672e9f30f472f"
server_key_iv: "23576146c75df34c7af683de163d6e65"
server_key_version: "encryptionkey@0"
I20260807 19:54:15.189688 15862 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:15.195379 15862 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:15.199465 15862 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:15.199767 15862 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:15.219223 15862 rpc_server.cc:307] RPC server started. Bound to: 127.0.0.1:32905
I20260807 19:54:15.219274 15977 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.0.0.1:32905 every 8 connection(s)
I20260807 19:54:15.220654 15862 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:15.224328 15982 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:15.229029 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 15862
I20260807 19:54:15.229224 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_11.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:15.229822 12910 external_mini_cluster.cc:1428] Setting key 6447c38bb9f5e9ec495c58c3d9256d05
I20260807 19:54:15.237226 15982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24: Bootstrap starting.
I20260807 19:54:15.239948 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:15.231970 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:43399 (local address 127.0.0.1:32905)
0807 19:54:15.232959 (+ 989us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:15.232975 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:15.233419 (+ 444us) server_negotiation.cc:407] Connection header received
0807 19:54:15.235957 (+ 2538us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:15.235987 (+ 30us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:15.236424 (+ 437us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:15.236892 (+ 468us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:15.237940 (+ 1048us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:15.237949 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:15.237966 (+ 17us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:15.237984 (+ 18us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:15.238052 (+ 68us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:15.238113 (+ 61us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:15.238327 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:15.238458 (+ 131us) server_negotiation.cc:299] Negotiation successful
0807 19:54:15.238648 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":702,"thread_start_us":403,"threads_started":1}
I20260807 19:54:15.241166 15982 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:15.242393 15982 log.cc:824] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:15.243856 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:15.245396 15982 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24: No bootstrap required, opened a new log
I20260807 19:54:15.251025 15986 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:15.248427 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 10.240.0.168:60651 (local address 127.0.0.1:32905)
0807 19:54:15.248615 (+ 188us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:15.248621 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:15.248965 (+ 344us) server_negotiation.cc:407] Connection header received
0807 19:54:15.249179 (+ 214us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:15.249186 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:15.249232 (+ 46us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:15.249340 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:15.250348 (+ 1008us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:15.250352 (+ 4us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:15.250355 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:15.250374 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:15.250411 (+ 37us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:15.250425 (+ 14us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:15.250557 (+ 132us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:15.250681 (+ 124us) server_negotiation.cc:299] Negotiation successful
0807 19:54:15.250769 (+ 88us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:54:15.254176 15982 raft_consensus.cc:348] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158b74df55c04cee947706b2e3423e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260807 19:54:15.254649 15982 raft_consensus.cc:374] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:15.254769 15982 raft_consensus.cc:729] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 158b74df55c04cee947706b2e3423e24, State: Initialized, Role: FOLLOWER
I20260807 19:54:15.255337 15982 consensus_queue.cc:260] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158b74df55c04cee947706b2e3423e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260807 19:54:15.255578 15982 raft_consensus.cc:388] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:15.255748 15982 raft_consensus.cc:482] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:15.255929 15982 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:15.258296 15982 raft_consensus.cc:504] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158b74df55c04cee947706b2e3423e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260807 19:54:15.258870 15982 leader_election.cc:302] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 158b74df55c04cee947706b2e3423e24; no voters:
I20260807 19:54:15.259753 15982 leader_election.cc:288] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:15.259984 15994 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:15.261890 15994 raft_consensus.cc:686] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [term 1 LEADER]: Becoming Leader. State: Replica: 158b74df55c04cee947706b2e3423e24, State: Running, Role: LEADER
I20260807 19:54:15.262513 15982 sys_catalog.cc:564] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:15.262589 15994 consensus_queue.cc:237] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158b74df55c04cee947706b2e3423e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } }
I20260807 19:54:15.265877 15995 sys_catalog.cc:455] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "158b74df55c04cee947706b2e3423e24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158b74df55c04cee947706b2e3423e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } } }
I20260807 19:54:15.265951 15997 sys_catalog.cc:455] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 158b74df55c04cee947706b2e3423e24. Latest consensus state: current_term: 1 leader_uuid: "158b74df55c04cee947706b2e3423e24" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "158b74df55c04cee947706b2e3423e24" member_type: VOTER last_known_addr { host: "127.0.0.1" port: 32905 } } }
I20260807 19:54:15.266356 15995 sys_catalog.cc:458] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:15.266392 15997 sys_catalog.cc:458] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:15.269469 16006 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:15.275592 16006 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:15.284965 16006 catalog_manager.cc:1347] Generated new cluster ID: f627618957d44fc49a2fc6306698d25a
I20260807 19:54:15.285089 16006 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:15.310429 16006 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:15.310882 16006 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:15.319960 16006 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 158b74df55c04cee947706b2e3423e24: Generated new TSK 0
I20260807 19:54:15.320930 16006 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:15.336088 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15862
W20260807 19:54:15.338106 15967 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 10.240.0.168:43399
W20260807 19:54:15.338896 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 15862: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:15.339068 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 15862
2026-08-07T19:54:15Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/11 (2244 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/12
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:15 dist-test-slave-2p8l krb5kdc[16029](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:15 dist-test-slave-2p8l krb5kdc[16029](info): set up 2 sockets
Aug 07 19:54:15 dist-test-slave-2p8l krb5kdc[16029](info): commencing operation
krb5kdc: starting...
W20260807 19:54:16.787147 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.402s user 0.000s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:16 dist-test-slave-2p8l krb5kdc[16029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:17Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:17Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:17.117100 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:33811
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:34137
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:33811
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:17.458355 16045 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:17.458640 16045 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:17.458734 16045 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:17.465868 16045 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:17.465983 16045 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:17.466040 16045 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:17.466122 16045 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:17.466167 16045 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:17.475724 16045 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:34137
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:33811
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:33811
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:17.476922 16045 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:17.478205 16045 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:17.490108 16059 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:17.490187 16056 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:17.490209 16055 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:17.490938 16045 server_base.cc:1034] running on GCE node
I20260807 19:54:17.491670 16045 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:17.493059 16045 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:17.494292 16045 hybrid_clock.cc:648] HybridClock initialized: now 1786132457494203 us; error 75 us; skew 500 ppm
I20260807 19:54:17.494597 16045 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:17 dist-test-slave-2p8l krb5kdc[16029](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132457, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:17.497730 16045 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:17.499243 16045 webserver.cc:460] Webserver started at http://127.12.155.190:40055/ using document root <none> and password file <none>
I20260807 19:54:17.500170 16045 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:17.500330 16045 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:17.500733 16045 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:17.503746 16045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "2fb5fca478de467da6351959484a03c9"
format_stamp: "Formatted at 2026-08-07 19:54:17 on dist-test-slave-2p8l"
server_key: "16bd939ef889001dfd97b2a659957579"
server_key_iv: "9e1972dd416349efdec24869619899ed"
server_key_version: "encryptionkey@0"
I20260807 19:54:17.504473 16045 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "2fb5fca478de467da6351959484a03c9"
format_stamp: "Formatted at 2026-08-07 19:54:17 on dist-test-slave-2p8l"
server_key: "16bd939ef889001dfd97b2a659957579"
server_key_iv: "9e1972dd416349efdec24869619899ed"
server_key_version: "encryptionkey@0"
I20260807 19:54:17.509572 16045 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.001s
I20260807 19:54:17.512984 16069 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:17.514393 16045 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:17.514536 16045 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "2fb5fca478de467da6351959484a03c9"
format_stamp: "Formatted at 2026-08-07 19:54:17 on dist-test-slave-2p8l"
server_key: "16bd939ef889001dfd97b2a659957579"
server_key_iv: "9e1972dd416349efdec24869619899ed"
server_key_version: "encryptionkey@0"
I20260807 19:54:17.514707 16045 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:17.528461 16045 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:17.532912 16045 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:17.533144 16045 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:17.552742 16045 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:33811
I20260807 19:54:17.552760 16154 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:33811 every 8 connection(s)
I20260807 19:54:17.554258 16045 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:17.556564 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16045
I20260807 19:54:17.556762 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_12.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:17.557214 12910 external_mini_cluster.cc:1428] Setting key 3c97b9b4d2a32a37d7bd988c73bf5f53
I20260807 19:54:17.558411 16156 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:54:17 dist-test-slave-2p8l krb5kdc[16029](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132456, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:17.572271 16156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9: Bootstrap starting.
I20260807 19:54:17.576493 16156 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:17.577811 16156 log.cc:824] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:17.581328 16156 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9: No bootstrap required, opened a new log
I20260807 19:54:17.581796 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:17.559205 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55967 (local address 127.12.155.190:33811)
0807 19:54:17.560016 (+ 811us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:17.560033 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:17.560084 (+ 51us) server_negotiation.cc:407] Connection header received
0807 19:54:17.561944 (+ 1860us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:17.561972 (+ 28us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:17.562504 (+ 532us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:17.562944 (+ 440us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:17.564235 (+ 1291us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:17.566385 (+ 2150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:17.567632 (+ 1247us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:17.568664 (+ 1032us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:17.568856 (+ 192us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:17.573002 (+ 4146us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:17.573013 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:17.573032 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:17.573075 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:17.577178 (+ 4103us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:17.577953 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:17.577961 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:17.577968 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:17.578200 (+ 232us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:17.578753 (+ 553us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:17.578757 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:17.578759 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:17.579391 (+ 632us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:17.579708 (+ 317us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:17.580141 (+ 433us) server_negotiation.cc:299] Negotiation successful
0807 19:54:17.580483 (+ 342us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":573,"thread_start_us":347,"threads_started":1}
I20260807 19:54:17.585892 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:17.589993 16156 raft_consensus.cc:348] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb5fca478de467da6351959484a03c9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33811 } }
I20260807 19:54:17.590510 16156 raft_consensus.cc:374] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:17.590624 16156 raft_consensus.cc:729] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 2fb5fca478de467da6351959484a03c9, State: Initialized, Role: FOLLOWER
I20260807 19:54:17.591264 16156 consensus_queue.cc:260] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb5fca478de467da6351959484a03c9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33811 } }
I20260807 19:54:17.591521 16156 raft_consensus.cc:388] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:17.591689 16156 raft_consensus.cc:482] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:17.591878 16156 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:17.594118 16156 raft_consensus.cc:504] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb5fca478de467da6351959484a03c9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33811 } }
I20260807 19:54:17.594620 16156 leader_election.cc:302] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 2fb5fca478de467da6351959484a03c9; no voters:
I20260807 19:54:17.595319 16156 leader_election.cc:288] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:17.595464 16181 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:17.597886 16156 sys_catalog.cc:564] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:17.602527 16181 raft_consensus.cc:686] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [term 1 LEADER]: Becoming Leader. State: Replica: 2fb5fca478de467da6351959484a03c9, State: Running, Role: LEADER
I20260807 19:54:17.603317 16181 consensus_queue.cc:237] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb5fca478de467da6351959484a03c9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33811 } }
I20260807 19:54:17.605926 16162 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:17.590221 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:46803 (local address 127.12.155.190:33811)
0807 19:54:17.590417 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:17.590425 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:17.591042 (+ 617us) server_negotiation.cc:407] Connection header received
0807 19:54:17.591244 (+ 202us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:17.591249 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:17.591320 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:17.591425 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:17.592990 (+ 1565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:17.593764 (+ 774us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:17.595185 (+ 1421us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:17.595980 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:17.596123 (+ 143us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:17.599039 (+ 2916us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:17.599050 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:17.599054 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:17.599083 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:17.602866 (+ 3783us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:17.603626 (+ 760us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:17.603631 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:17.603634 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:17.603804 (+ 170us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:17.604287 (+ 483us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:17.604291 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:17.604293 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:17.604639 (+ 346us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:17.604948 (+ 309us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:17.605357 (+ 409us) server_negotiation.cc:299] Negotiation successful
0807 19:54:17.605528 (+ 171us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
I20260807 19:54:17.612067 16186 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "2fb5fca478de467da6351959484a03c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb5fca478de467da6351959484a03c9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33811 } } }
I20260807 19:54:17.612471 16186 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:17.612263 16187 sys_catalog.cc:455] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 2fb5fca478de467da6351959484a03c9. Latest consensus state: current_term: 1 leader_uuid: "2fb5fca478de467da6351959484a03c9" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "2fb5fca478de467da6351959484a03c9" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 33811 } } }
I20260807 19:54:17.612636 16187 sys_catalog.cc:458] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:17.615176 16196 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:17.619926 16196 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:17.628119 16196 catalog_manager.cc:1347] Generated new cluster ID: 16d815ef4aea490c80ab54c667902a60
I20260807 19:54:17.628243 16196 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:17.644685 16196 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:17.645999 16196 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:17.655268 16196 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 2fb5fca478de467da6351959484a03c9: Generated new TSK 0
I20260807 19:54:17.656086 16196 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:17.665086 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16045
I20260807 19:54:17.666354 16147 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:17.758733 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16045
W20260807 19:54:17.785279 16026 connection.cc:535] client connection to 127.12.155.190:33811 recv error: Network error: failed to read from TLS socket (remote: 127.12.155.190:33811): Connection reset by peer (error 104)
2026-08-07T19:54:17Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/12 (2419 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/13
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:17 dist-test-slave-2p8l krb5kdc[16215](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:17 dist-test-slave-2p8l krb5kdc[16215](info): set up 2 sockets
Aug 07 19:54:17 dist-test-slave-2p8l krb5kdc[16215](info): commencing operation
krb5kdc: starting...
W20260807 19:54:19.195844 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.391s user 0.001s sys 0.041s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:19 dist-test-slave-2p8l krb5kdc[16215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132459, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:19Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:19Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:19.535797 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:41063
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:36025
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:41063
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:19.891456 16238 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:19.891788 16238 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:19.891969 16238 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:19.899327 16238 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:19.899494 16238 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:19.899600 16238 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:19.899721 16238 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:19.899803 16238 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:19.910151 16238 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:36025
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:41063
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:41063
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:19.911523 16238 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:19.913059 16238 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:19.925158 16248 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:19.925261 16253 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:19.925124 16257 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:19.925994 16238 server_base.cc:1034] running on GCE node
I20260807 19:54:19.926822 16238 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:19.928241 16238 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:19.929448 16238 hybrid_clock.cc:648] HybridClock initialized: now 1786132459929405 us; error 41 us; skew 500 ppm
I20260807 19:54:19.929807 16238 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:19 dist-test-slave-2p8l krb5kdc[16215](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132459, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:19.933104 16238 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:19.934751 16238 webserver.cc:460] Webserver started at http://127.12.155.190:36607/ using document root <none> and password file <none>
I20260807 19:54:19.935458 16238 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:19.935628 16238 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:19.935947 16238 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:19.939069 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "3d105da8708a40349168d9508350268c"
format_stamp: "Formatted at 2026-08-07 19:54:19 on dist-test-slave-2p8l"
server_key: "9cce1dfb2036ede801045800a0f32d18"
server_key_iv: "4a0af84ae61a4de74ff41fbf6c083554"
server_key_version: "encryptionkey@0"
I20260807 19:54:19.939867 16238 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "3d105da8708a40349168d9508350268c"
format_stamp: "Formatted at 2026-08-07 19:54:19 on dist-test-slave-2p8l"
server_key: "9cce1dfb2036ede801045800a0f32d18"
server_key_iv: "4a0af84ae61a4de74ff41fbf6c083554"
server_key_version: "encryptionkey@0"
I20260807 19:54:19.945153 16238 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:54:19.948747 16268 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:19.950366 16238 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:19.950584 16238 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "3d105da8708a40349168d9508350268c"
format_stamp: "Formatted at 2026-08-07 19:54:19 on dist-test-slave-2p8l"
server_key: "9cce1dfb2036ede801045800a0f32d18"
server_key_iv: "4a0af84ae61a4de74ff41fbf6c083554"
server_key_version: "encryptionkey@0"
I20260807 19:54:19.950814 16238 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:19.972358 16238 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:19.976764 16238 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:19.977065 16238 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:19.996109 16238 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:41063
I20260807 19:54:19.996119 16345 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:41063 every 8 connection(s)
I20260807 19:54:19.997557 16238 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:19.998437 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16238
I20260807 19:54:19.998672 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_13.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:19.999257 12910 external_mini_cluster.cc:1428] Setting key b6e437d10a1cc7c22b2e722a8ad90732
I20260807 19:54:20.003286 16348 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:20.015024 16353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:20.001257 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:39943 (local address 127.12.155.190:41063)
0807 19:54:20.003846 (+ 2589us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:20.003858 (+ 12us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:20.003901 (+ 43us) server_negotiation.cc:407] Connection header received
0807 19:54:20.005587 (+ 1686us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:20.005609 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:20.006003 (+ 394us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:20.006436 (+ 433us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:20.007118 (+ 682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:20.008497 (+ 1379us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:20.010496 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:20.011143 (+ 647us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:20.011291 (+ 148us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:20.012661 (+ 1370us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:20.012671 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:20.012686 (+ 15us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:20.013257 (+ 571us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:20.013335 (+ 78us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:20.013367 (+ 32us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:20.013495 (+ 128us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:20.013804 (+ 309us) server_negotiation.cc:299] Negotiation successful
0807 19:54:20.014021 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":2376,"thread_start_us":2130,"threads_started":1}
I20260807 19:54:20.016121 16348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c: Bootstrap starting.
I20260807 19:54:20.019409 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:20.020310 16348 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:20.021553 16348 log.cc:824] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:20.024386 16348 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c: No bootstrap required, opened a new log
I20260807 19:54:20.031826 16353 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:20.024954 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58767 (local address 127.12.155.190:41063)
0807 19:54:20.025145 (+ 191us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:20.025152 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:20.025530 (+ 378us) server_negotiation.cc:407] Connection header received
0807 19:54:20.025699 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:20.025704 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:20.025788 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:20.025904 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:20.026444 (+ 540us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:20.027666 (+ 1222us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:20.028991 (+ 1325us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:20.029726 (+ 735us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:20.029858 (+ 132us) server_negotiation.cc:662] Negotiated TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:20.031038 (+ 1180us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:20.031046 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:20.031051 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:20.031077 (+ 26us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:20.031121 (+ 44us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:20.031144 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:20.031271 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:20.031431 (+ 160us) server_negotiation.cc:299] Negotiation successful
0807 19:54:20.031483 (+ 52us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":64}
I20260807 19:54:20.034581 16348 raft_consensus.cc:348] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d105da8708a40349168d9508350268c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41063 } }
I20260807 19:54:20.034981 16348 raft_consensus.cc:374] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:20.035138 16348 raft_consensus.cc:729] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3d105da8708a40349168d9508350268c, State: Initialized, Role: FOLLOWER
I20260807 19:54:20.035851 16348 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d105da8708a40349168d9508350268c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41063 } }
I20260807 19:54:20.036073 16348 raft_consensus.cc:388] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:20.036175 16348 raft_consensus.cc:482] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:20.036307 16348 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:20.038533 16348 raft_consensus.cc:504] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d105da8708a40349168d9508350268c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41063 } }
I20260807 19:54:20.038969 16348 leader_election.cc:302] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3d105da8708a40349168d9508350268c; no voters:
I20260807 19:54:20.039533 16348 leader_election.cc:288] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:20.039685 16361 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:20.040381 16361 raft_consensus.cc:686] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [term 1 LEADER]: Becoming Leader. State: Replica: 3d105da8708a40349168d9508350268c, State: Running, Role: LEADER
I20260807 19:54:20.040947 16361 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d105da8708a40349168d9508350268c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41063 } }
I20260807 19:54:20.041774 16348 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:20.043695 16363 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3d105da8708a40349168d9508350268c. Latest consensus state: current_term: 1 leader_uuid: "3d105da8708a40349168d9508350268c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d105da8708a40349168d9508350268c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41063 } } }
I20260807 19:54:20.044289 16363 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:20.044286 16362 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3d105da8708a40349168d9508350268c" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3d105da8708a40349168d9508350268c" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 41063 } } }
I20260807 19:54:20.044677 16362 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:20.049543 16370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:20.054005 16370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:20.062579 16370 catalog_manager.cc:1347] Generated new cluster ID: 8b050e640d754c4082ac17706c3a5f1e
I20260807 19:54:20.062716 16370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:20.074085 16370 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:20.075419 16370 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:20.083585 16370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 3d105da8708a40349168d9508350268c: Generated new TSK 0
I20260807 19:54:20.084409 16370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:20.092345 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16238
W20260807 19:54:20.093649 16338 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:39943
W20260807 19:54:20.094537 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16238: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:20.094694 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16238
W20260807 19:54:20.122373 16213 connection.cc:535] client connection to 127.12.155.190:41063 recv error: Network error: failed to read from TLS socket (remote: 127.12.155.190:41063): Connection reset by peer (error 104)
2026-08-07T19:54:20Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/13 (2336 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/14
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:20 dist-test-slave-2p8l krb5kdc[16389](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:20 dist-test-slave-2p8l krb5kdc[16389](info): set up 2 sockets
Aug 07 19:54:20 dist-test-slave-2p8l krb5kdc[16389](info): commencing operation
krb5kdc: starting...
W20260807 19:54:21.458810 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.317s user 0.000s sys 0.043s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:21 dist-test-slave-2p8l krb5kdc[16389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132461, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:21Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:21Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:21.789536 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42015
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:46545
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:42015
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=true with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:22.135686 16420 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:22.136005 16420 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:22.136171 16420 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:22.143419 16420 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:22.143529 16420 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:22.143616 16420 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:22.143740 16420 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:22.143805 16420 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:22.153721 16420 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:46545
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:42015
--rpc_encrypt_loopback_connections=true
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:42015
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:22.155120 16420 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:22.156467 16420 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:22.168772 16433 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:22.168835 16427 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:22.168809 16429 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:22.169644 16420 server_base.cc:1034] running on GCE node
I20260807 19:54:22.170552 16420 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:22.171972 16420 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:22.173218 16420 hybrid_clock.cc:648] HybridClock initialized: now 1786132462173152 us; error 53 us; skew 500 ppm
I20260807 19:54:22.173629 16420 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:22 dist-test-slave-2p8l krb5kdc[16389](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132462, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:22.177160 16420 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:22.178814 16420 webserver.cc:460] Webserver started at http://127.12.155.190:38489/ using document root <none> and password file <none>
I20260807 19:54:22.179539 16420 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:22.179706 16420 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:22.180037 16420 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:22.183266 16420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "7d8a3f4f857a40eb863b76691ef60302"
format_stamp: "Formatted at 2026-08-07 19:54:22 on dist-test-slave-2p8l"
server_key: "0c2cc9e3e765f65b9cb7e2bc95b84d09"
server_key_iv: "5afd1f5fab0cb07a7a2c3eadc6ad12c5"
server_key_version: "encryptionkey@0"
I20260807 19:54:22.184051 16420 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "7d8a3f4f857a40eb863b76691ef60302"
format_stamp: "Formatted at 2026-08-07 19:54:22 on dist-test-slave-2p8l"
server_key: "0c2cc9e3e765f65b9cb7e2bc95b84d09"
server_key_iv: "5afd1f5fab0cb07a7a2c3eadc6ad12c5"
server_key_version: "encryptionkey@0"
I20260807 19:54:22.189320 16420 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:54:22.193011 16449 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:22.194483 16420 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20260807 19:54:22.194684 16420 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "7d8a3f4f857a40eb863b76691ef60302"
format_stamp: "Formatted at 2026-08-07 19:54:22 on dist-test-slave-2p8l"
server_key: "0c2cc9e3e765f65b9cb7e2bc95b84d09"
server_key_iv: "5afd1f5fab0cb07a7a2c3eadc6ad12c5"
server_key_version: "encryptionkey@0"
I20260807 19:54:22.194901 16420 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:22.200836 16420 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:22.205410 16420 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:22.205848 16420 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:22.224939 16420 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:42015
I20260807 19:54:22.224973 16537 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:42015 every 8 connection(s)
I20260807 19:54:22.226426 16420 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:22.230014 16538 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:22.231415 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16420
I20260807 19:54:22.231626 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_14.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:22.232095 12910 external_mini_cluster.cc:1428] Setting key 2606e3c9cd4fdc71b69dc896bf926723
I20260807 19:54:22.240016 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:22.233998 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:54439 (local address 127.12.155.190:42015)
0807 19:54:22.234878 (+ 880us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:22.234889 (+ 11us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:22.234933 (+ 44us) server_negotiation.cc:407] Connection header received
0807 19:54:22.236577 (+ 1644us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:22.236600 (+ 23us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:22.236949 (+ 349us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:22.237347 (+ 398us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:22.238431 (+ 1084us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:22.238437 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:22.238450 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:22.238464 (+ 14us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:22.238521 (+ 57us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:22.238544 (+ 23us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:22.238817 (+ 273us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:22.238965 (+ 148us) server_negotiation.cc:299] Negotiation successful
0807 19:54:22.239142 (+ 177us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":647,"thread_start_us":363,"threads_started":1}
I20260807 19:54:22.243430 16538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302: Bootstrap starting.
I20260807 19:54:22.243873 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:22.247349 16538 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:22.248823 16538 log.cc:824] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:22.251855 16538 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302: No bootstrap required, opened a new log
I20260807 19:54:22.254729 16541 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:22.249548 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:34461 (local address 127.12.155.190:42015)
0807 19:54:22.249810 (+ 262us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:22.249817 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:22.252515 (+ 2698us) server_negotiation.cc:407] Connection header received
0807 19:54:22.252725 (+ 210us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:22.252729 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:22.252776 (+ 47us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:22.252887 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:22.253937 (+ 1050us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:22.253948 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:22.253951 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:22.253967 (+ 16us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:22.254012 (+ 45us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:22.254027 (+ 15us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:22.254254 (+ 227us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:22.254349 (+ 95us) server_negotiation.cc:299] Negotiation successful
0807 19:54:22.254420 (+ 71us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:54:22.260046 16538 raft_consensus.cc:348] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8a3f4f857a40eb863b76691ef60302" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42015 } }
I20260807 19:54:22.260426 16538 raft_consensus.cc:374] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:22.260528 16538 raft_consensus.cc:729] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d8a3f4f857a40eb863b76691ef60302, State: Initialized, Role: FOLLOWER
I20260807 19:54:22.261091 16538 consensus_queue.cc:260] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8a3f4f857a40eb863b76691ef60302" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42015 } }
I20260807 19:54:22.261364 16538 raft_consensus.cc:388] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:22.261544 16538 raft_consensus.cc:482] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:22.261729 16538 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:22.263969 16538 raft_consensus.cc:504] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8a3f4f857a40eb863b76691ef60302" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42015 } }
I20260807 19:54:22.264488 16538 leader_election.cc:302] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 7d8a3f4f857a40eb863b76691ef60302; no voters:
I20260807 19:54:22.265094 16538 leader_election.cc:288] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:22.265250 16553 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:22.266294 16553 raft_consensus.cc:686] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [term 1 LEADER]: Becoming Leader. State: Replica: 7d8a3f4f857a40eb863b76691ef60302, State: Running, Role: LEADER
I20260807 19:54:22.266942 16553 consensus_queue.cc:237] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8a3f4f857a40eb863b76691ef60302" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42015 } }
I20260807 19:54:22.267431 16538 sys_catalog.cc:564] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:22.269848 16555 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "7d8a3f4f857a40eb863b76691ef60302" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8a3f4f857a40eb863b76691ef60302" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42015 } } }
I20260807 19:54:22.270287 16555 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:22.270812 16556 sys_catalog.cc:455] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 7d8a3f4f857a40eb863b76691ef60302. Latest consensus state: current_term: 1 leader_uuid: "7d8a3f4f857a40eb863b76691ef60302" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "7d8a3f4f857a40eb863b76691ef60302" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 42015 } } }
I20260807 19:54:22.271155 16556 sys_catalog.cc:458] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:22.271344 16564 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:22.282315 16564 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:22.294126 16564 catalog_manager.cc:1347] Generated new cluster ID: 6aeffaddc8064841a13a86c4d4216f11
I20260807 19:54:22.294262 16564 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:22.308224 16564 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:22.308666 16564 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:22.320271 16564 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 7d8a3f4f857a40eb863b76691ef60302: Generated new TSK 0
I20260807 19:54:22.321264 16564 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:22.336524 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16420
W20260807 19:54:22.337661 16529 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:54439
W20260807 19:54:22.338406 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16420: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:22.338567 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16420
2026-08-07T19:54:22Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/14 (2242 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/15
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:22 dist-test-slave-2p8l krb5kdc[16586](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:22 dist-test-slave-2p8l krb5kdc[16586](info): set up 2 sockets
Aug 07 19:54:22 dist-test-slave-2p8l krb5kdc[16586](info): commencing operation
krb5kdc: starting...
W20260807 19:54:23.718941 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.335s user 0.000s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:23 dist-test-slave-2p8l krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:23Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:23Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:24.045626 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43579
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:45241
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43579
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=required
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:24.389967 16607 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:24.390343 16607 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:24.390520 16607 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:24.397698 16607 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:24.397847 16607 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:24.397958 16607 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:24.398090 16607 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:24.398161 16607 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:24.408077 16607 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:45241
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43579
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43579
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:24.409422 16607 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:24.410823 16607 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:24.426402 16615 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:24.426471 16618 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:24.426510 16616 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:24.427476 16607 server_base.cc:1034] running on GCE node
I20260807 19:54:24.428236 16607 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:24.429677 16607 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:24.430883 16607 hybrid_clock.cc:648] HybridClock initialized: now 1786132464430844 us; error 38 us; skew 500 ppm
I20260807 19:54:24.431281 16607 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:24 dist-test-slave-2p8l krb5kdc[16586](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132464, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:24.434500 16607 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:24.436035 16607 webserver.cc:460] Webserver started at http://127.12.155.190:39777/ using document root <none> and password file <none>
I20260807 19:54:24.436759 16607 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:24.436920 16607 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:24.437247 16607 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:24.440322 16607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "220d7c9e69924ebf86bea9e5ff7ad856"
format_stamp: "Formatted at 2026-08-07 19:54:24 on dist-test-slave-2p8l"
server_key: "106163e36abb60a985565d02dd528657"
server_key_iv: "a03c1998b751b766d80a3b82faa854b3"
server_key_version: "encryptionkey@0"
I20260807 19:54:24.441108 16607 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "220d7c9e69924ebf86bea9e5ff7ad856"
format_stamp: "Formatted at 2026-08-07 19:54:24 on dist-test-slave-2p8l"
server_key: "106163e36abb60a985565d02dd528657"
server_key_iv: "a03c1998b751b766d80a3b82faa854b3"
server_key_version: "encryptionkey@0"
I20260807 19:54:24.446384 16607 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.000s
I20260807 19:54:24.449733 16627 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:24.451148 16607 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:24.451344 16607 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "220d7c9e69924ebf86bea9e5ff7ad856"
format_stamp: "Formatted at 2026-08-07 19:54:24 on dist-test-slave-2p8l"
server_key: "106163e36abb60a985565d02dd528657"
server_key_iv: "a03c1998b751b766d80a3b82faa854b3"
server_key_version: "encryptionkey@0"
I20260807 19:54:24.451562 16607 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:24.478701 16607 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:24.483013 16607 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:24.483342 16607 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:24.503832 16607 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43579
I20260807 19:54:24.503852 16723 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43579 every 8 connection(s)
I20260807 19:54:24.505342 16607 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:24.508424 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16607
I20260807 19:54:24.508682 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_15.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:24.509181 12910 external_mini_cluster.cc:1428] Setting key 3a4b49c940914a83af7c7728f778ac7d
I20260807 19:54:24.510159 16724 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
Aug 07 19:54:24 dist-test-slave-2p8l krb5kdc[16586](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132463, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:24.526278 16724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856: Bootstrap starting.
I20260807 19:54:24.531140 16724 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:24.532713 16724 log.cc:824] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:24.535694 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:24.511292 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:55665 (local address 127.12.155.190:43579)
0807 19:54:24.512205 (+ 913us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:24.512222 (+ 17us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:24.512281 (+ 59us) server_negotiation.cc:407] Connection header received
0807 19:54:24.514335 (+ 2054us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:24.514367 (+ 32us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:24.514961 (+ 594us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:24.515468 (+ 507us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:24.516742 (+ 1274us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:24.519093 (+ 2351us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:24.520414 (+ 1321us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:24.521565 (+ 1151us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:24.521786 (+ 221us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:24.526211 (+ 4425us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:24.526225 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:24.526251 (+ 26us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:24.526314 (+ 63us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:24.530743 (+ 4429us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:24.531530 (+ 787us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:24.531543 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:24.531553 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:24.531814 (+ 261us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:24.532191 (+ 377us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:24.532201 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:24.532206 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:24.533017 (+ 811us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:24.533371 (+ 354us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:24.533797 (+ 426us) server_negotiation.cc:299] Negotiation successful
0807 19:54:24.534252 (+ 455us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":633,"thread_start_us":365,"threads_started":1}
I20260807 19:54:24.536769 16724 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856: No bootstrap required, opened a new log
I20260807 19:54:24.539737 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:24.546546 16724 raft_consensus.cc:348] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43579 } }
I20260807 19:54:24.547003 16724 raft_consensus.cc:374] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:24.547143 16724 raft_consensus.cc:729] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 220d7c9e69924ebf86bea9e5ff7ad856, State: Initialized, Role: FOLLOWER
I20260807 19:54:24.547778 16724 consensus_queue.cc:260] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43579 } }
I20260807 19:54:24.548062 16724 raft_consensus.cc:388] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:24.548240 16724 raft_consensus.cc:482] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:24.548437 16724 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:24.551295 16724 raft_consensus.cc:504] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43579 } }
I20260807 19:54:24.551928 16724 leader_election.cc:302] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 220d7c9e69924ebf86bea9e5ff7ad856; no voters:
I20260807 19:54:24.552778 16724 leader_election.cc:288] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:24.552929 16735 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:24.555783 16724 sys_catalog.cc:564] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:24.557736 16735 raft_consensus.cc:686] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [term 1 LEADER]: Becoming Leader. State: Replica: 220d7c9e69924ebf86bea9e5ff7ad856, State: Running, Role: LEADER
I20260807 19:54:24.558609 16735 consensus_queue.cc:237] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43579 } }
I20260807 19:54:24.559245 16727 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:24.544159 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:59427 (local address 127.12.155.190:43579)
0807 19:54:24.544364 (+ 205us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:24.544373 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:24.544787 (+ 414us) server_negotiation.cc:407] Connection header received
0807 19:54:24.545011 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:24.545015 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:24.545075 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:24.545200 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:24.546757 (+ 1557us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:24.547786 (+ 1029us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:24.549259 (+ 1473us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:24.549769 (+ 510us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:24.549929 (+ 160us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:24.552425 (+ 2496us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:24.552443 (+ 18us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:24.552447 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:24.552478 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:24.556172 (+ 3694us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:24.556833 (+ 661us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:24.556839 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:24.556843 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:24.556998 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:24.557394 (+ 396us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:24.557400 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:24.557404 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:24.557906 (+ 502us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:24.558249 (+ 343us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:24.558572 (+ 323us) server_negotiation.cc:299] Negotiation successful
0807 19:54:24.558809 (+ 237us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":56}
I20260807 19:54:24.562878 16737 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43579 } } }
I20260807 19:54:24.563321 16737 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:24.562795 16738 sys_catalog.cc:455] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 220d7c9e69924ebf86bea9e5ff7ad856. Latest consensus state: current_term: 1 leader_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "220d7c9e69924ebf86bea9e5ff7ad856" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43579 } } }
I20260807 19:54:24.564587 16738 sys_catalog.cc:458] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:24.565855 16749 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:24.571434 16749 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:24.580823 16749 catalog_manager.cc:1347] Generated new cluster ID: 3b6b4bedb071422f903a47bfe948e872
I20260807 19:54:24.581049 16749 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:24.609198 16749 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:24.610981 16749 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:24.616892 16749 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 220d7c9e69924ebf86bea9e5ff7ad856: Generated new TSK 0
I20260807 19:54:24.617894 16749 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:24.627627 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16607
I20260807 19:54:24.628795 16718 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:24.721920 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16607
2026-08-07T19:54:24Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/15 (2384 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/16
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:24 dist-test-slave-2p8l krb5kdc[16766](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:24 dist-test-slave-2p8l krb5kdc[16766](info): set up 2 sockets
Aug 07 19:54:24 dist-test-slave-2p8l krb5kdc[16766](info): commencing operation
krb5kdc: starting...
W20260807 19:54:26.087146 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.319s user 0.001s sys 0.045s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:26 dist-test-slave-2p8l krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132466, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:26Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:26Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:26.397285 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:44109
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:40679
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:44109
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=required
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:26.742923 16798 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:26.743212 16798 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:26.743403 16798 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:26.750599 16798 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:26.750730 16798 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:26.750836 16798 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:26.750936 16798 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:26.751015 16798 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:26.760746 16798 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:40679
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:44109
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:44109
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=required
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:26.762048 16798 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:26.763448 16798 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:26.775744 16811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:26.775833 16807 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:26.775959 16808 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:26.776605 16798 server_base.cc:1034] running on GCE node
I20260807 19:54:26.777431 16798 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:26.778964 16798 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:26.780210 16798 hybrid_clock.cc:648] HybridClock initialized: now 1786132466780153 us; error 56 us; skew 500 ppm
I20260807 19:54:26.780573 16798 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:26 dist-test-slave-2p8l krb5kdc[16766](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132466, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:26.788844 16798 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:26.790575 16798 webserver.cc:460] Webserver started at http://127.12.155.190:46211/ using document root <none> and password file <none>
I20260807 19:54:26.791317 16798 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:26.791476 16798 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:26.791795 16798 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:26.794979 16798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "74be12c0c26a440d8cf096622299759f"
format_stamp: "Formatted at 2026-08-07 19:54:26 on dist-test-slave-2p8l"
server_key: "0c8e211771849c688f9fedaa617d7ee5"
server_key_iv: "07422c6df515f2ba98c6e69c2383a594"
server_key_version: "encryptionkey@0"
I20260807 19:54:26.795787 16798 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "74be12c0c26a440d8cf096622299759f"
format_stamp: "Formatted at 2026-08-07 19:54:26 on dist-test-slave-2p8l"
server_key: "0c8e211771849c688f9fedaa617d7ee5"
server_key_iv: "07422c6df515f2ba98c6e69c2383a594"
server_key_version: "encryptionkey@0"
I20260807 19:54:26.801287 16798 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.003s
I20260807 19:54:26.805048 16819 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:26.806512 16798 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:26.806720 16798 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "74be12c0c26a440d8cf096622299759f"
format_stamp: "Formatted at 2026-08-07 19:54:26 on dist-test-slave-2p8l"
server_key: "0c8e211771849c688f9fedaa617d7ee5"
server_key_iv: "07422c6df515f2ba98c6e69c2383a594"
server_key_version: "encryptionkey@0"
I20260807 19:54:26.806929 16798 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:26.835750 16798 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:26.840162 16798 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:26.840479 16798 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:26.862190 16798 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:44109
I20260807 19:54:26.862227 16916 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:44109 every 8 connection(s)
I20260807 19:54:26.863706 16798 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:26.867096 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16798
I20260807 19:54:26.867291 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_16.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:26.867960 12910 external_mini_cluster.cc:1428] Setting key 26a40b3d5baeb642a5b5c7804b5754cf
I20260807 19:54:26.868296 16917 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:26.884940 16921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:26.870029 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:51617 (local address 127.12.155.190:44109)
0807 19:54:26.871123 (+ 1094us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:26.871139 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:26.871198 (+ 59us) server_negotiation.cc:407] Connection header received
0807 19:54:26.873729 (+ 2531us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:26.873760 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:26.874337 (+ 577us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:26.874814 (+ 477us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:26.875381 (+ 567us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:26.877682 (+ 2301us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:26.879116 (+ 1434us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:26.880343 (+ 1227us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:26.880576 (+ 233us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:26.881805 (+ 1229us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:26.881819 (+ 14us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:26.881844 (+ 25us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:26.882686 (+ 842us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:26.882796 (+ 110us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:26.882843 (+ 47us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:26.882966 (+ 123us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:26.883226 (+ 260us) server_negotiation.cc:299] Negotiation successful
0807 19:54:26.883521 (+ 295us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":803,"thread_start_us":531,"threads_started":1}
I20260807 19:54:26.885172 16917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f: Bootstrap starting.
I20260807 19:54:26.888888 16917 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:26.889277 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:26.890030 16917 log.cc:824] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:26.893316 16917 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f: No bootstrap required, opened a new log
I20260807 19:54:26.901546 16921 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:26.894433 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:42075 (local address 127.12.155.190:44109)
0807 19:54:26.894639 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:26.894646 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:26.894986 (+ 340us) server_negotiation.cc:407] Connection header received
0807 19:54:26.895104 (+ 118us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:26.895109 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:26.895202 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:26.895323 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:26.895893 (+ 570us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:26.897137 (+ 1244us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:26.898598 (+ 1461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:26.899440 (+ 842us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:26.899592 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:26.900699 (+ 1107us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:26.900706 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:26.900712 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:26.900734 (+ 22us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:26.900792 (+ 58us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:26.900813 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:26.900907 (+ 94us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:26.901048 (+ 141us) server_negotiation.cc:299] Negotiation successful
0807 19:54:26.901150 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:54:26.904170 16917 raft_consensus.cc:348] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74be12c0c26a440d8cf096622299759f" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44109 } }
I20260807 19:54:26.904735 16917 raft_consensus.cc:374] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:26.904910 16917 raft_consensus.cc:729] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 74be12c0c26a440d8cf096622299759f, State: Initialized, Role: FOLLOWER
I20260807 19:54:26.905614 16917 consensus_queue.cc:260] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74be12c0c26a440d8cf096622299759f" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44109 } }
I20260807 19:54:26.905895 16917 raft_consensus.cc:388] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:26.906095 16917 raft_consensus.cc:482] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:26.906308 16917 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:26.908957 16917 raft_consensus.cc:504] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74be12c0c26a440d8cf096622299759f" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44109 } }
I20260807 19:54:26.909803 16917 leader_election.cc:302] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 74be12c0c26a440d8cf096622299759f; no voters:
I20260807 19:54:26.910454 16917 leader_election.cc:288] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:26.910599 16931 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:26.912461 16931 raft_consensus.cc:686] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [term 1 LEADER]: Becoming Leader. State: Replica: 74be12c0c26a440d8cf096622299759f, State: Running, Role: LEADER
I20260807 19:54:26.913039 16917 sys_catalog.cc:564] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:26.912990 16931 consensus_queue.cc:237] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74be12c0c26a440d8cf096622299759f" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44109 } }
I20260807 19:54:26.916263 16932 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "74be12c0c26a440d8cf096622299759f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74be12c0c26a440d8cf096622299759f" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44109 } } }
I20260807 19:54:26.915999 16933 sys_catalog.cc:455] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 74be12c0c26a440d8cf096622299759f. Latest consensus state: current_term: 1 leader_uuid: "74be12c0c26a440d8cf096622299759f" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "74be12c0c26a440d8cf096622299759f" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 44109 } } }
I20260807 19:54:26.916749 16932 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:26.916749 16933 sys_catalog.cc:458] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:26.919010 16941 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:26.924499 16941 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:26.933310 16941 catalog_manager.cc:1347] Generated new cluster ID: e24cbbefa9284281b8f142e628d7d611
I20260807 19:54:26.933423 16941 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:26.947757 16941 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:26.949097 16941 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:26.956359 16941 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 74be12c0c26a440d8cf096622299759f: Generated new TSK 0
I20260807 19:54:26.957304 16941 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:26.964037 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16798
W20260807 19:54:26.965297 16910 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:51617
W20260807 19:54:26.966033 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16798: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:26.966230 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16798
2026-08-07T19:54:26Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/16 (2243 ms)
[ RUN ] AuthTokenIssuingTest.ChannelConfidentiality/17
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:27 dist-test-slave-2p8l krb5kdc[16960](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:27 dist-test-slave-2p8l krb5kdc[16960](info): set up 2 sockets
Aug 07 19:54:27 dist-test-slave-2p8l krb5kdc[16960](info): commencing operation
krb5kdc: starting...
W20260807 19:54:28.348876 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.337s user 0.004s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:28 dist-test-slave-2p8l krb5kdc[16960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132468, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:28Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:28Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:28.679575 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43025
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:42117
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:43025
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--user_acl=*
--rpc_authentication=disabled
--rpc_encryption=disabled
--rpc_encrypt_loopback_connections=false with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:29.030169 16975 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:29.030611 16975 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:29.030802 16975 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:29.038038 16975 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:29.038230 16975 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:29.038342 16975 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:29.038455 16975 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:29.038550 16975 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:29.050494 16975 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:42117
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:43025
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:43025
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=disabled
--rpc_encryption=disabled
--superuser_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:29.052322 16975 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:29.053985 16975 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:29.067777 16985 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:29.067737 16988 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:29.067823 16992 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:29.069054 16975 server_base.cc:1034] running on GCE node
I20260807 19:54:29.069907 16975 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:29.071583 16975 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:29.072817 16975 hybrid_clock.cc:648] HybridClock initialized: now 1786132469072749 us; error 55 us; skew 500 ppm
I20260807 19:54:29.073232 16975 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:29 dist-test-slave-2p8l krb5kdc[16960](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132469, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:29.076864 16975 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:29.078469 16975 webserver.cc:460] Webserver started at http://127.12.155.190:40743/ using document root <none> and password file <none>
I20260807 19:54:29.079223 16975 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:29.079339 16975 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:29.079622 16975 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:29.083040 16975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "ef247203973d4cc79ff53b61544bfcff"
format_stamp: "Formatted at 2026-08-07 19:54:29 on dist-test-slave-2p8l"
server_key: "810c666cc9299569f667221ba7c9ad7a"
server_key_iv: "cee2df0213c5126c2dbc7662650ca02c"
server_key_version: "encryptionkey@0"
I20260807 19:54:29.083828 16975 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "ef247203973d4cc79ff53b61544bfcff"
format_stamp: "Formatted at 2026-08-07 19:54:29 on dist-test-slave-2p8l"
server_key: "810c666cc9299569f667221ba7c9ad7a"
server_key_iv: "cee2df0213c5126c2dbc7662650ca02c"
server_key_version: "encryptionkey@0"
I20260807 19:54:29.089406 16975 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.006s sys 0.000s
I20260807 19:54:29.093304 17008 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:29.094848 16975 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:29.095055 16975 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "ef247203973d4cc79ff53b61544bfcff"
format_stamp: "Formatted at 2026-08-07 19:54:29 on dist-test-slave-2p8l"
server_key: "810c666cc9299569f667221ba7c9ad7a"
server_key_iv: "cee2df0213c5126c2dbc7662650ca02c"
server_key_version: "encryptionkey@0"
I20260807 19:54:29.095268 16975 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:29.101107 16975 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:29.105163 16975 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:29.105465 16975 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:29.124657 16975 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:43025
I20260807 19:54:29.124701 17093 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:43025 every 8 connection(s)
I20260807 19:54:29.126197 16975 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:29.130224 17095 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:29.132033 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 16975
I20260807 19:54:29.132233 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.AuthTokenIssuingTest.ChannelConfidentiality_17.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:29.132745 12910 external_mini_cluster.cc:1428] Setting key ab264c46e303bf43dc4d08318de38750
I20260807 19:54:29.141469 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:29.134655 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:56001 (local address 127.12.155.190:43025)
0807 19:54:29.135556 (+ 901us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:29.135572 (+ 16us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:29.135624 (+ 52us) server_negotiation.cc:407] Connection header received
0807 19:54:29.137431 (+ 1807us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:29.137462 (+ 31us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:29.137942 (+ 480us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:29.138392 (+ 450us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:29.139449 (+ 1057us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:29.139461 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:29.139480 (+ 19us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:29.139503 (+ 23us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:29.139580 (+ 77us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:29.139608 (+ 28us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:29.139852 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:29.139989 (+ 137us) server_negotiation.cc:299] Negotiation successful
0807 19:54:29.140179 (+ 190us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":626,"thread_start_us":369,"threads_started":1}
I20260807 19:54:29.144690 17095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff: Bootstrap starting.
I20260807 19:54:29.145398 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:29.148447 17095 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:29.149969 17095 log.cc:824] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:29.153402 17095 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff: No bootstrap required, opened a new log
I20260807 19:54:29.153471 17099 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:29.150902 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52933 (local address 127.12.155.190:43025)
0807 19:54:29.151112 (+ 210us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:29.151121 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:29.151513 (+ 392us) server_negotiation.cc:407] Connection header received
0807 19:54:29.151696 (+ 183us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:29.151701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:29.151756 (+ 55us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:29.151869 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:29.152824 (+ 955us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:29.152829 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:29.152833 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: PLAIN
0807 19:54:29.152852 (+ 19us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:29.152900 (+ 48us) server_negotiation.cc:1091] Received PLAIN auth, user=slave
0807 19:54:29.152921 (+ 21us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:29.153048 (+ 127us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:29.153122 (+ 74us) server_negotiation.cc:299] Negotiation successful
0807 19:54:29.153180 (+ 58us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
I20260807 19:54:29.161289 17095 raft_consensus.cc:348] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef247203973d4cc79ff53b61544bfcff" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43025 } }
I20260807 19:54:29.161667 17095 raft_consensus.cc:374] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20260807 19:54:29.161746 17095 raft_consensus.cc:729] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef247203973d4cc79ff53b61544bfcff, State: Initialized, Role: FOLLOWER
I20260807 19:54:29.162389 17095 consensus_queue.cc:260] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef247203973d4cc79ff53b61544bfcff" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43025 } }
I20260807 19:54:29.162611 17095 raft_consensus.cc:388] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20260807 19:54:29.162716 17095 raft_consensus.cc:482] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20260807 19:54:29.162842 17095 raft_consensus.cc:3037] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:29.165088 17095 raft_consensus.cc:504] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef247203973d4cc79ff53b61544bfcff" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43025 } }
I20260807 19:54:29.165632 17095 leader_election.cc:302] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: ef247203973d4cc79ff53b61544bfcff; no voters:
I20260807 19:54:29.166266 17095 leader_election.cc:288] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [CANDIDATE]: Term 1 election: Requested vote from peers
I20260807 19:54:29.166435 17109 raft_consensus.cc:2781] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:29.167163 17109 raft_consensus.cc:686] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [term 1 LEADER]: Becoming Leader. State: Replica: ef247203973d4cc79ff53b61544bfcff, State: Running, Role: LEADER
I20260807 19:54:29.167697 17109 consensus_queue.cc:237] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef247203973d4cc79ff53b61544bfcff" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43025 } }
I20260807 19:54:29.168421 17095 sys_catalog.cc:564] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:29.170764 17115 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [sys.catalog]: SysCatalogTable state changed. Reason: New leader ef247203973d4cc79ff53b61544bfcff. Latest consensus state: current_term: 1 leader_uuid: "ef247203973d4cc79ff53b61544bfcff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef247203973d4cc79ff53b61544bfcff" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43025 } } }
I20260807 19:54:29.171268 17115 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:29.171909 17114 sys_catalog.cc:455] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "ef247203973d4cc79ff53b61544bfcff" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "ef247203973d4cc79ff53b61544bfcff" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 43025 } } }
I20260807 19:54:29.172250 17114 sys_catalog.cc:458] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:29.174621 17123 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:29.180222 17123 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:29.190196 17123 catalog_manager.cc:1347] Generated new cluster ID: de7ed85866c14bb2933ea098d9a9f0a4
I20260807 19:54:29.190361 17123 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:29.203594 17123 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:29.204106 17123 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:29.211707 17123 catalog_manager.cc:5868] T 00000000000000000000000000000000 P ef247203973d4cc79ff53b61544bfcff: Generated new TSK 0
I20260807 19:54:29.212668 17123 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:29.225230 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16975
W20260807 19:54:29.226670 17085 server_base.cc:1116] Unauthorized access attempt to method kudu.server.GenericService.CheckLeaks from {username='slave'} at 127.0.0.1:56001
W20260807 19:54:29.227413 12910 external_mini_cluster.cc:1652] Unable to check leaks on /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 16975: Remote error: Not authorized: unauthorized access to method: CheckLeaks
I20260807 19:54:29.227582 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 16975
2026-08-07T19:54:29Z chronyd exiting
[ OK ] AuthTokenIssuingTest.ChannelConfidentiality/17 (2262 ms)
[----------] 18 tests from AuthTokenIssuingTest (41897 ms total)
[----------] 2 tests from ConnectToFollowerMasterTest
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:29 dist-test-slave-2p8l krb5kdc[17146](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:29 dist-test-slave-2p8l krb5kdc[17146](info): set up 2 sockets
Aug 07 19:54:29 dist-test-slave-2p8l krb5kdc[17146](info): commencing operation
krb5kdc: starting...
W20260807 19:54:30.661535 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.387s user 0.000s sys 0.046s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:30 dist-test-slave-2p8l krb5kdc[17146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:30Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:30Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:30.989579 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40111
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40111,127.12.155.189:35799,127.12.155.188:33615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:31.337414 17172 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 19:54:31.337814 17172 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:31.337944 17172 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:31.338121 17172 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:31.345814 17172 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:31.345938 17172 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:31.346036 17172 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:31.346174 17172 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:31.346278 17172 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:31.356186 17172 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40111,127.12.155.189:35799,127.12.155.188:33615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:40111
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:31.357494 17172 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:31.358891 17172 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:31.370803 17179 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:31.370942 17180 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:31.370836 17185 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:31.372373 17172 server_base.cc:1034] running on GCE node
I20260807 19:54:31.373224 17172 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:31.374647 17172 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:31.375914 17172 hybrid_clock.cc:648] HybridClock initialized: now 1786132471375855 us; error 50 us; skew 500 ppm
I20260807 19:54:31.376271 17172 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:31 dist-test-slave-2p8l krb5kdc[17146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:31.379534 17172 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:31.381050 17172 webserver.cc:460] Webserver started at http://127.12.155.190:37271/ using document root <none> and password file <none>
I20260807 19:54:31.381711 17172 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:31.381801 17172 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:31.382113 17172 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:31.385042 17172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "80cff945ce834330a36f3154ec227dd1"
format_stamp: "Formatted at 2026-08-07 19:54:31 on dist-test-slave-2p8l"
server_key: "c3511b4b659d6bb1d3c37e531146febc"
server_key_iv: "1b3fe975d40beac6518609e857d17551"
server_key_version: "encryptionkey@0"
I20260807 19:54:31.385789 17172 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "80cff945ce834330a36f3154ec227dd1"
format_stamp: "Formatted at 2026-08-07 19:54:31 on dist-test-slave-2p8l"
server_key: "c3511b4b659d6bb1d3c37e531146febc"
server_key_iv: "1b3fe975d40beac6518609e857d17551"
server_key_version: "encryptionkey@0"
I20260807 19:54:31.390825 17172 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.002s sys 0.001s
I20260807 19:54:31.394276 17202 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:31.395581 17172 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.002s sys 0.001s
I20260807 19:54:31.395782 17172 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "80cff945ce834330a36f3154ec227dd1"
format_stamp: "Formatted at 2026-08-07 19:54:31 on dist-test-slave-2p8l"
server_key: "c3511b4b659d6bb1d3c37e531146febc"
server_key_iv: "1b3fe975d40beac6518609e857d17551"
server_key_version: "encryptionkey@0"
I20260807 19:54:31.396003 17172 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:31.408669 17172 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:31.412676 17172 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:31.412952 17172 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:31.431996 17172 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:40111
I20260807 19:54:31.432017 17289 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:40111 every 8 connection(s)
I20260807 19:54:31.433396 17172 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:31.437177 17291 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:31.441988 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17172
I20260807 19:54:31.442260 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:31.442914 12910 external_mini_cluster.cc:1428] Setting key e97b31614fb7419bf9e954793b6cd496
I20260807 19:54:31.443902 17291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:31 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:31.465840 17297 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.446950 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52882 (local address 127.12.155.190:40111)
0807 19:54:31.448571 (+ 1621us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:31.448580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:31.448634 (+ 54us) server_negotiation.cc:407] Connection header received
0807 19:54:31.450195 (+ 1561us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:31.450201 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:31.450417 (+ 216us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:31.450623 (+ 206us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:31.451907 (+ 1284us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.453132 (+ 1225us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.454583 (+ 1451us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.455114 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.455310 (+ 196us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:31.458724 (+ 3414us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:31.458732 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:31.458743 (+ 11us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:31.458771 (+ 28us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:31.461489 (+ 2718us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:31.462217 (+ 728us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:31.462224 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:31.462227 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:31.462366 (+ 139us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:31.462779 (+ 413us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:31.462790 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:31.462793 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:31.463258 (+ 465us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:31.463472 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:31.464005 (+ 533us) server_negotiation.cc:299] Negotiation successful
0807 19:54:31.464306 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":1400,"thread_start_us":1194,"threads_started":1}
I20260807 19:54:31.465867 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.446949 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40111 (local address 127.0.0.1:52882)
0807 19:54:31.447779 (+ 830us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.447837 (+ 58us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:31.449814 (+ 1977us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:31.450650 (+ 836us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:31.450656 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:31.451371 (+ 715us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:31.451693 (+ 322us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:31.451709 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.453288 (+ 1579us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.453294 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:31.454438 (+ 1144us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:31.454451 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.455351 (+ 900us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.455357 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:31.455542 (+ 185us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:31.456242 (+ 700us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:31.456265 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:31.458489 (+ 2224us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:31.461634 (+ 3145us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:31.461646 (+ 12us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:31.461657 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:31.462041 (+ 384us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:31.462479 (+ 438us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:31.462486 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:31.462492 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:31.462660 (+ 168us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:31.463400 (+ 740us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:31.463407 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:31.463632 (+ 225us) client_negotiation.cc:769] Sending connection context
0807 19:54:31.463865 (+ 233us) client_negotiation.cc:240] Negotiation successful
0807 19:54:31.464467 (+ 602us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":580,"mutex_wait_us":150,"thread_start_us":361,"threads_started":1}
I20260807 19:54:31.468775 17291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:31.470018 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.469480 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43100)
0807 19:54:31.469702 (+ 222us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.469842 (+ 140us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":76}
W20260807 19:54:31.470309 17204 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
I20260807 19:54:31.472110 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.471588 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43114)
0807 19:54:31.471793 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.471891 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":78}
W20260807 19:54:31.472545 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:35799: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.155.189@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab.
Entry for principal kudu/127.12.155.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab.
I20260807 19:54:31.516987 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:35799
--webserver_interface=127.12.155.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab
--principal=kudu/127.12.155.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40111,127.12.155.189:35799,127.12.155.188:33615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:54:31.521912 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } attempt: 1
I20260807 19:54:31.523264 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.522795 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43128)
0807 19:54:31.522997 (+ 202us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.523122 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:54:31.524351 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.523971 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43130)
0807 19:54:31.524136 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.524219 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":56}
W20260807 19:54:31.524595 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:35799: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
I20260807 19:54:31.592921 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } attempt: 2
I20260807 19:54:31.594267 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.593723 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43144)
0807 19:54:31.593973 (+ 250us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.594114 (+ 141us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 19:54:31.595357 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.595009 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43156)
0807 19:54:31.595165 (+ 156us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.595234 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 19:54:31.595652 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:35799: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
I20260807 19:54:31.686882 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } attempt: 3
I20260807 19:54:31.688040 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.687586 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43160)
0807 19:54:31.687801 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.687901 (+ 100us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":77}
I20260807 19:54:31.689080 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.688716 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43166)
0807 19:54:31.688871 (+ 155us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.688944 (+ 73us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 19:54:31.689271 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:35799: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
I20260807 19:54:31.832526 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } attempt: 4
I20260807 19:54:31.834033 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.833287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43180)
0807 19:54:31.833688 (+ 401us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.833821 (+ 133us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":189}
I20260807 19:54:31.835258 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.834807 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43190)
0807 19:54:31.834989 (+ 182us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.835102 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 19:54:31.835469 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:35799: Network error: Client connection negotiation failed: client connection to 127.12.155.189:35799: connect: Connection refused (error 111)
W20260807 19:54:31.862036 17302 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 19:54:31.862435 17302 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:31.862565 17302 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:31.862715 17302 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:31.870004 17302 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:31.870119 17302 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:31.870180 17302 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:31.870224 17302 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:31.870316 17302 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:31.880437 17302 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40111,127.12.155.189:35799,127.12.155.188:33615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab
--principal=kudu/127.12.155.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:35799
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.155.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:31.881827 17302 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:31.883308 17302 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:31.895152 17318 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:31.895100 17312 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:31.895188 17311 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:31.896152 17302 server_base.cc:1034] running on GCE node
I20260807 19:54:31.896966 17302 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:31.898456 17302 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:31.899721 17302 hybrid_clock.cc:648] HybridClock initialized: now 1786132471899660 us; error 37 us; skew 500 ppm
I20260807 19:54:31.900086 17302 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:31 dist-test-slave-2p8l krb5kdc[17146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:31.906901 17302 init.cc:377] Logged in from keytab as kudu/127.12.155.189@KRBTEST.COM (short username kudu)
I20260807 19:54:31.908433 17302 webserver.cc:460] Webserver started at http://127.12.155.189:42249/ using document root <none> and password file <none>
I20260807 19:54:31.909153 17302 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:31.909299 17302 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:31.909639 17302 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:31.912742 17302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data/instance:
uuid: "71f0d384bf1241a8bb6b8a337422804f"
format_stamp: "Formatted at 2026-08-07 19:54:31 on dist-test-slave-2p8l"
server_key: "832c0b089445baea3e974d1ddf8f17c1"
server_key_iv: "db99d431514fdbd46d401aea8143d620"
server_key_version: "encryptionkey@0"
I20260807 19:54:31.913573 17302 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal/instance:
uuid: "71f0d384bf1241a8bb6b8a337422804f"
format_stamp: "Formatted at 2026-08-07 19:54:31 on dist-test-slave-2p8l"
server_key: "832c0b089445baea3e974d1ddf8f17c1"
server_key_iv: "db99d431514fdbd46d401aea8143d620"
server_key_version: "encryptionkey@0"
I20260807 19:54:31.918936 17302 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.007s sys 0.001s
I20260807 19:54:31.922547 17336 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:31.923936 17302 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.001s
I20260807 19:54:31.924125 17302 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal
uuid: "71f0d384bf1241a8bb6b8a337422804f"
format_stamp: "Formatted at 2026-08-07 19:54:31 on dist-test-slave-2p8l"
server_key: "832c0b089445baea3e974d1ddf8f17c1"
server_key_iv: "db99d431514fdbd46d401aea8143d620"
server_key_version: "encryptionkey@0"
I20260807 19:54:31.924360 17302 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:31.946317 17302 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:31.950618 17302 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:31.950908 17302 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:31.970700 17302 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.189:35799
I20260807 19:54:31.970745 17421 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.189:35799 every 8 connection(s)
I20260807 19:54:31.972044 17302 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
I20260807 19:54:31.975795 17422 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:31.979609 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17302
I20260807 19:54:31.979818 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-1/wal/instance
I20260807 19:54:31.980361 12910 external_mini_cluster.cc:1428] Setting key a9062122be6f90c014bd6737f5a53deb
I20260807 19:54:31.983989 17422 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:31 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:32.006497 17426 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.987341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52898 (local address 127.12.155.190:40111)
0807 19:54:31.987878 (+ 537us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:31.987886 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:31.988899 (+ 1013us) server_negotiation.cc:407] Connection header received
0807 19:54:31.990834 (+ 1935us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:31.990842 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:31.990950 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:31.991083 (+ 133us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:31.992555 (+ 1472us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.993696 (+ 1141us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.995256 (+ 1560us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.995977 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.996088 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.000483 (+ 4395us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.000488 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.000491 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.000534 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.003391 (+ 2857us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.004137 (+ 746us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.004149 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.004152 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.004269 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.004714 (+ 445us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.004719 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.004729 (+ 10us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.005007 (+ 278us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.005170 (+ 163us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.005863 (+ 693us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.006110 (+ 247us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":386,"thread_start_us":259,"threads_started":1}
I20260807 19:54:32.007434 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:31.987889 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40111 (local address 127.0.0.1:52898)
0807 19:54:31.988713 (+ 824us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:31.988768 (+ 55us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:31.990562 (+ 1794us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:31.991267 (+ 705us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:31.991274 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:31.991804 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:31.992337 (+ 533us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:31.992353 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.993864 (+ 1511us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.993868 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:31.995098 (+ 1230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:31.995110 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:31.996220 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:31.996229 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:31.996543 (+ 314us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:31.997313 (+ 770us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:31.997346 (+ 33us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.000250 (+ 2904us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.003542 (+ 3292us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.003551 (+ 9us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.003567 (+ 16us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.004000 (+ 433us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.004386 (+ 386us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.004391 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.004395 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.004587 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.005153 (+ 566us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.005161 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.005496 (+ 335us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.005763 (+ 267us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.006296 (+ 533us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":529,"thread_start_us":348,"threads_started":1}
I20260807 19:54:32.009368 17422 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } has no permanent_uuid. Determining permanent_uuid...
WARNING: no policy specified for kudu/127.12.155.188@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.188@KRBTEST.COM" created.
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:32.023825 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.010080 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43204)
0807 19:54:32.010394 (+ 314us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.010416 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.010534 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.011421 (+ 887us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.011427 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.011933 (+ 506us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.012121 (+ 188us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.012135 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.013526 (+ 1391us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.013530 (+ 4us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.014491 (+ 961us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.014503 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.015329 (+ 826us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.015334 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.015498 (+ 164us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.016098 (+ 600us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.016120 (+ 22us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.018254 (+ 2134us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.021288 (+ 3034us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.021295 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.021299 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.021661 (+ 362us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.022038 (+ 377us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.022043 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.022047 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.022211 (+ 164us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.022838 (+ 627us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.022846 (+ 8us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.022984 (+ 138us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.023139 (+ 155us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.023408 (+ 269us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":173}
I20260807 19:54:32.023957 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.010319 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43204 (local address 127.12.155.189:35799)
0807 19:54:32.011009 (+ 690us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.011014 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.011040 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:54:32.011081 (+ 41us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.011086 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.011244 (+ 158us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.011355 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.012308 (+ 953us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.013392 (+ 1084us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.014630 (+ 1238us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.015142 (+ 512us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.015242 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.018450 (+ 3208us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.018461 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.018473 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.018503 (+ 30us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.021159 (+ 2656us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.021802 (+ 643us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.021808 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.021810 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.021923 (+ 113us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.022342 (+ 419us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.022345 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.022347 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.022713 (+ 366us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.022935 (+ 222us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.023270 (+ 335us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.023524 (+ 254us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":23,"server-negotiator.queue_time_us":540,"thread_start_us":398,"threads_started":1}
I20260807 19:54:32.026222 17422 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:32.027307 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.026866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53436)
0807 19:54:32.027045 (+ 179us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.027162 (+ 117us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:54:32.027630 17337 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.031518 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.031092 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53448)
0807 19:54:32.031265 (+ 173us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.031361 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
W20260807 19:54:32.031766 17422 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab.
Entry for principal kudu/127.12.155.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab.
I20260807 19:54:32.057366 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:33615
--webserver_interface=127.12.155.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab
--principal=kudu/127.12.155.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:32865
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:40111,127.12.155.189:35799,127.12.155.188:33615
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=optional with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:54:32.081079 17422 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 1
I20260807 19:54:32.082628 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.081887 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53454)
0807 19:54:32.082235 (+ 348us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.082392 (+ 157us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
I20260807 19:54:32.083930 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.083418 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53456)
0807 19:54:32.083635 (+ 217us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.083753 (+ 118us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":57}
W20260807 19:54:32.084195 17422 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.134687 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } attempt: 5
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:32.149138 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.135513 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43206)
0807 19:54:32.135867 (+ 354us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.135887 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.136022 (+ 135us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.136441 (+ 419us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.136449 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.136860 (+ 411us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.137050 (+ 190us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.137059 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.138055 (+ 996us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.138100 (+ 45us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.139001 (+ 901us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.139014 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.139779 (+ 765us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.139786 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.139984 (+ 198us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.140705 (+ 721us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.140723 (+ 18us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.142936 (+ 2213us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.146826 (+ 3890us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.146830 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.146832 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.147211 (+ 379us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.147619 (+ 408us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.147623 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.147625 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.147758 (+ 133us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.148430 (+ 672us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.148434 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.148554 (+ 120us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.148681 (+ 127us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.148896 (+ 215us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":209}
I20260807 19:54:32.149402 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.135860 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43206 (local address 127.12.155.189:35799)
0807 19:54:32.136081 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.136090 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.136111 (+ 21us) server_negotiation.cc:407] Connection header received
0807 19:54:32.136212 (+ 101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.136216 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.136277 (+ 61us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.136398 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.137216 (+ 818us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.137913 (+ 697us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.139162 (+ 1249us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.139606 (+ 444us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.139747 (+ 141us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.143151 (+ 3404us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.143159 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.143164 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.143205 (+ 41us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.146692 (+ 3487us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.147331 (+ 639us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.147337 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.147340 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.147507 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.147865 (+ 358us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.147871 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.147876 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.148279 (+ 403us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.148434 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.148833 (+ 399us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.149098 (+ 265us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":84}
I20260807 19:54:32.150533 17291 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:32.151510 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.151149 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53460)
0807 19:54:32.151308 (+ 159us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.151391 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
I20260807 19:54:32.152452 17422 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 2
I20260807 19:54:32.152590 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.152176 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53472)
0807 19:54:32.152345 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.152458 (+ 113us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 19:54:32.152794 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.153434 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.152934 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53486)
0807 19:54:32.153138 (+ 204us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.153246 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
I20260807 19:54:32.154513 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.154131 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53494)
0807 19:54:32.154279 (+ 148us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.154362 (+ 83us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":47}
W20260807 19:54:32.154778 17422 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.204038 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 1
I20260807 19:54:32.205204 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.204719 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53502)
0807 19:54:32.204924 (+ 205us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.205032 (+ 108us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:54:32.206339 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.205984 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53508)
0807 19:54:32.206172 (+ 188us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.206239 (+ 67us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 19:54:32.206566 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.246034 17422 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 3
I20260807 19:54:32.247339 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.246776 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53518)
0807 19:54:32.247021 (+ 245us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.247146 (+ 125us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":90}
I20260807 19:54:32.248553 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.248057 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53520)
0807 19:54:32.248313 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.248408 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":148}
W20260807 19:54:32.248792 17422 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.274796 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 2
I20260807 19:54:32.276005 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.275493 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53528)
0807 19:54:32.275727 (+ 234us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.275836 (+ 109us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":74}
I20260807 19:54:32.277099 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.276751 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53530)
0807 19:54:32.276916 (+ 165us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.276996 (+ 80us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 19:54:32.277335 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.383560 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 3
I20260807 19:54:32.384801 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.384292 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53534)
0807 19:54:32.384513 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.384616 (+ 103us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":66}
I20260807 19:54:32.385955 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.385571 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53536)
0807 19:54:32.385778 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.385860 (+ 82us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":110}
W20260807 19:54:32.386282 17291 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
I20260807 19:54:32.392023 17422 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 4
I20260807 19:54:32.393162 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.392722 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53538)
0807 19:54:32.392928 (+ 206us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.393007 (+ 79us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":68}
I20260807 19:54:32.394199 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.393817 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53540)
0807 19:54:32.393969 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.394040 (+ 71us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":52}
W20260807 19:54:32.394443 17422 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:33615: Network error: Client connection negotiation failed: client connection to 127.12.155.188:33615: connect: Connection refused (error 111)
W20260807 19:54:32.420765 17433 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 19:54:32.421159 17433 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:32.421288 17433 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:32.421432 17433 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:32.428984 17433 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:32.429126 17433 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:32.429236 17433 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:32.429345 17433 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:32.429433 17433 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:32.443989 17433 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:32865
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:40111,127.12.155.189:35799,127.12.155.188:33615
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab
--principal=kudu/127.12.155.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:33615
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.155.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:32.445255 17433 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:32.446623 17433 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:32.458576 17442 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:32.458626 17443 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:32.458658 17446 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:32.459587 17433 server_base.cc:1034] running on GCE node
I20260807 19:54:32.460297 17433 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:32.461675 17433 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:32.462932 17433 hybrid_clock.cc:648] HybridClock initialized: now 1786132472462856 us; error 51 us; skew 500 ppm
I20260807 19:54:32.463342 17433 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132472, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:32.466516 17433 init.cc:377] Logged in from keytab as kudu/127.12.155.188@KRBTEST.COM (short username kudu)
I20260807 19:54:32.467975 17433 webserver.cc:460] Webserver started at http://127.12.155.188:42829/ using document root <none> and password file <none>
I20260807 19:54:32.468680 17433 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:32.468820 17433 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:32.469151 17433 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:32.472095 17433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data/instance:
uuid: "233ec30a952845f2b2670f3730c5250e"
format_stamp: "Formatted at 2026-08-07 19:54:32 on dist-test-slave-2p8l"
server_key: "4b5759b47ee1a567268e8cce57ac4565"
server_key_iv: "a748196962e3f589721bbe5787e202de"
server_key_version: "encryptionkey@0"
I20260807 19:54:32.472916 17433 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal/instance:
uuid: "233ec30a952845f2b2670f3730c5250e"
format_stamp: "Formatted at 2026-08-07 19:54:32 on dist-test-slave-2p8l"
server_key: "4b5759b47ee1a567268e8cce57ac4565"
server_key_iv: "a748196962e3f589721bbe5787e202de"
server_key_version: "encryptionkey@0"
I20260807 19:54:32.478150 17433 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.003s sys 0.004s
I20260807 19:54:32.481480 17457 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:32.483060 17433 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20260807 19:54:32.483259 17433 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal
uuid: "233ec30a952845f2b2670f3730c5250e"
format_stamp: "Formatted at 2026-08-07 19:54:32 on dist-test-slave-2p8l"
server_key: "4b5759b47ee1a567268e8cce57ac4565"
server_key_iv: "a748196962e3f589721bbe5787e202de"
server_key_version: "encryptionkey@0"
I20260807 19:54:32.483497 17433 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:32.500118 17433 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:32.504338 17433 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:32.504632 17433 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:32.524304 17433 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.188:33615
I20260807 19:54:32.524358 17546 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.188:33615 every 8 connection(s)
I20260807 19:54:32.525728 17433 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
I20260807 19:54:32.529970 17547 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:32.534875 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17433
I20260807 19:54:32.535089 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_0.1786132073392555-12910-0/minicluster-data/master-2/wal/instance
I20260807 19:54:32.535565 12910 external_mini_cluster.cc:1428] Setting key 617d739e54cb8f4d0ca4a6e47d866f4f
I20260807 19:54:32.537470 17547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132472, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:54:32.556892 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.540230 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52906 (local address 127.12.155.190:40111)
0807 19:54:32.540778 (+ 548us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.540786 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.541346 (+ 560us) server_negotiation.cc:407] Connection header received
0807 19:54:32.541696 (+ 350us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.541701 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.541812 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.541928 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.543367 (+ 1439us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.544060 (+ 693us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.545862 (+ 1802us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.546525 (+ 663us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.546646 (+ 121us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.550526 (+ 3880us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.550532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.550535 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.550574 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.553443 (+ 2869us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.554470 (+ 1027us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.554475 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.554477 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.554624 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.555124 (+ 500us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.555127 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.555130 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.555389 (+ 259us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.555562 (+ 173us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.556271 (+ 709us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.556490 (+ 219us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":412,"thread_start_us":338,"threads_started":1}
I20260807 19:54:32.557842 17552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.540237 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:40111 (local address 127.0.0.1:52906)
0807 19:54:32.541181 (+ 944us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.541227 (+ 46us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.541458 (+ 231us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.542040 (+ 582us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.542047 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.542780 (+ 733us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.543178 (+ 398us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.543196 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.544217 (+ 1021us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.544222 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.545699 (+ 1477us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.545711 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.546774 (+ 1063us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.546781 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.547043 (+ 262us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.547866 (+ 823us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.547887 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.550316 (+ 2429us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.553578 (+ 3262us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.553589 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.553600 (+ 11us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.554344 (+ 744us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.554758 (+ 414us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.554763 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.554768 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.555008 (+ 240us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.555530 (+ 522us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.555539 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.555870 (+ 331us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.556161 (+ 291us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.556651 (+ 490us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":724,"thread_start_us":593,"threads_started":1}
I20260807 19:54:32.558781 17550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.537592 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53546 (local address 127.12.155.188:33615)
0807 19:54:32.538538 (+ 946us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.538551 (+ 13us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.538598 (+ 47us) server_negotiation.cc:407] Connection header received
0807 19:54:32.540977 (+ 2379us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.541012 (+ 35us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.541482 (+ 470us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.541829 (+ 347us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.543387 (+ 1558us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.544987 (+ 1600us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.546669 (+ 1682us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.547474 (+ 805us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.547577 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.552063 (+ 4486us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.552072 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.552084 (+ 12us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.552149 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.555384 (+ 3235us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.556048 (+ 664us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.556054 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.556056 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.556197 (+ 141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.556580 (+ 383us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.556584 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.556586 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.556931 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.557263 (+ 332us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.557769 (+ 506us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.558022 (+ 253us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":699,"thread_start_us":449,"threads_started":1}
I20260807 19:54:32.559712 17547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:32.563498 17291 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 4
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132472, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:54:32.574702 17552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.560369 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:35799 (local address 127.0.0.1:43210)
0807 19:54:32.560532 (+ 163us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.560616 (+ 84us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.560697 (+ 81us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.561096 (+ 399us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.561101 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.561440 (+ 339us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.561730 (+ 290us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.561744 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.562815 (+ 1071us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.562820 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.564263 (+ 1443us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.564277 (+ 14us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.565207 (+ 930us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.565213 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.565399 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.565976 (+ 577us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.565992 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.568429 (+ 2437us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.571934 (+ 3505us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.571940 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.571944 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.572297 (+ 353us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.572692 (+ 395us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.572697 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.572701 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.572882 (+ 181us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.573604 (+ 722us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.573609 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.573844 (+ 235us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.574014 (+ 170us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.574376 (+ 362us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":44,"spinlock_wait_cycles":27008}
I20260807 19:54:32.574892 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.560511 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43210 (local address 127.12.155.189:35799)
0807 19:54:32.560719 (+ 208us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.560725 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.560770 (+ 45us) server_negotiation.cc:407] Connection header received
0807 19:54:32.560835 (+ 65us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.560842 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.560923 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.561044 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.561874 (+ 830us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.562670 (+ 796us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.564388 (+ 1718us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.565044 (+ 656us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.565184 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.568635 (+ 3451us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.568640 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.568643 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.568676 (+ 33us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.571801 (+ 3125us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.572427 (+ 626us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.572440 (+ 13us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.572442 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.572570 (+ 128us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.572993 (+ 423us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.572999 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.573002 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.573347 (+ 345us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.573502 (+ 155us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.574170 (+ 668us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.574426 (+ 256us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:54:32.576718 17547 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:32.580009 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.561884 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52914 (local address 127.12.155.190:40111)
0807 19:54:32.562101 (+ 217us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.562107 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.562124 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:54:32.562181 (+ 57us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.562185 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.562245 (+ 60us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.562350 (+ 105us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.563812 (+ 1462us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.564880 (+ 1068us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.566725 (+ 1845us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.567286 (+ 561us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.567440 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.572526 (+ 5086us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.572532 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.572537 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.572574 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.576174 (+ 3600us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.576971 (+ 797us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.576978 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.576984 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.577148 (+ 164us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.577643 (+ 495us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.577648 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.577651 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.578075 (+ 424us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.578352 (+ 277us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.579458 (+ 1106us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.579748 (+ 290us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":66}
I20260807 19:54:32.580647 17295 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.564085 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53552)
0807 19:54:32.564331 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.564352 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.564467 (+ 115us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.564796 (+ 329us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.564802 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.565351 (+ 549us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.565537 (+ 186us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.565549 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.566906 (+ 1357us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.566911 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.568834 (+ 1923us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.568852 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.569797 (+ 945us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.569804 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.570032 (+ 228us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.570606 (+ 574us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.570645 (+ 39us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.573457 (+ 2812us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.577421 (+ 3964us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.577426 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.577430 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.577952 (+ 522us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.578470 (+ 518us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.578475 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.578481 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.578664 (+ 183us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.579468 (+ 804us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.579472 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.579735 (+ 263us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.579914 (+ 179us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.580238 (+ 324us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":132,"mutex_wait_us":70}
I20260807 19:54:32.581593 17550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.564127 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53552 (local address 127.12.155.188:33615)
0807 19:54:32.564289 (+ 162us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.564294 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.564418 (+ 124us) server_negotiation.cc:407] Connection header received
0807 19:54:32.564587 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.564592 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.564670 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.564768 (+ 98us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.565712 (+ 944us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.566776 (+ 1064us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.569000 (+ 2224us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.569616 (+ 616us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.569761 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.573657 (+ 3896us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.573665 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.573670 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.573704 (+ 34us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.577275 (+ 3571us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.578168 (+ 893us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.578173 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.578176 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.578333 (+ 157us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.578806 (+ 473us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.578813 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.578818 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.579212 (+ 394us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.579377 (+ 165us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.581048 (+ 1671us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.581294 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":59}
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132472, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:54:32.586915 17291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: Bootstrap starting.
I20260807 19:54:32.590456 17291 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:32.591944 17291 log.cc:824] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:32.592449 17552 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.577390 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53562)
0807 19:54:32.577686 (+ 296us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.577711 (+ 25us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.577833 (+ 122us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.578752 (+ 919us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.578760 (+ 8us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.579282 (+ 522us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.579461 (+ 179us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.579473 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.581468 (+ 1995us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.581473 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.582692 (+ 1219us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.582705 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.583592 (+ 887us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.583597 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.583858 (+ 261us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.584467 (+ 609us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.584484 (+ 17us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.586501 (+ 2017us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.589687 (+ 3186us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.589692 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.589696 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.590245 (+ 549us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.590732 (+ 487us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.590743 (+ 11us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.590746 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.590874 (+ 128us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.591386 (+ 512us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.591390 (+ 4us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.591526 (+ 136us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.591668 (+ 142us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.591981 (+ 313us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":154,"mutex_wait_us":22}
I20260807 19:54:32.592517 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.577434 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53562 (local address 127.12.155.188:33615)
0807 19:54:32.578441 (+ 1007us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.578446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.578466 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:54:32.578508 (+ 42us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.578514 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.578583 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.578705 (+ 122us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.579646 (+ 941us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.581331 (+ 1685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.582833 (+ 1502us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.583440 (+ 607us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.583584 (+ 144us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.586712 (+ 3128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.586717 (+ 5us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.586721 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.586768 (+ 47us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.589554 (+ 2786us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.590379 (+ 825us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.590384 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.590387 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.590542 (+ 155us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.590989 (+ 447us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.590994 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.590997 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.591269 (+ 272us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.591421 (+ 152us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.591781 (+ 360us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.592095 (+ 314us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":161,"server-negotiator.queue_time_us":887,"thread_start_us":688,"threads_started":1}
I20260807 19:54:32.595496 17291 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: No bootstrap required, opened a new log
I20260807 19:54:32.597630 17547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: Bootstrap starting.
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132470, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:32.601329 17547 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:32.602586 17547 log.cc:824] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:32.605583 17291 raft_consensus.cc:348] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.605911 17291 raft_consensus.cc:729] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 80cff945ce834330a36f3154ec227dd1, State: Initialized, Role: FOLLOWER
I20260807 19:54:32.606231 17547 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: No bootstrap required, opened a new log
I20260807 19:54:32.606464 17291 consensus_queue.cc:260] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.609397 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.583199 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43214 (local address 127.12.155.189:35799)
0807 19:54:32.590260 (+ 7061us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.590265 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.590279 (+ 14us) server_negotiation.cc:407] Connection header received
0807 19:54:32.590350 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.590356 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.590436 (+ 80us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.590547 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.592297 (+ 1750us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.593399 (+ 1102us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.595190 (+ 1791us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.595843 (+ 653us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.595966 (+ 123us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.601710 (+ 5744us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.601717 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.601722 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.601766 (+ 44us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.605774 (+ 4008us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.606710 (+ 936us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.606717 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.606720 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.606892 (+ 172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.607388 (+ 496us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.607396 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.607402 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.607877 (+ 475us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.608247 (+ 370us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.608561 (+ 314us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.608877 (+ 316us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6946}
I20260807 19:54:32.613530 17558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.615384 17291 sys_catalog.cc:564] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:32.615446 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:32.615533 17558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:32.616148 17547 raft_consensus.cc:348] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.616679 17547 raft_consensus.cc:729] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 233ec30a952845f2b2670f3730c5250e, State: Initialized, Role: FOLLOWER
I20260807 19:54:32.617264 17547 consensus_queue.cc:260] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.619426 17254 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "80cff945ce834330a36f3154ec227dd1"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:52914
I20260807 19:54:32.619992 17254 raft_consensus.cc:482] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
I20260807 19:54:32.620230 17254 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:32.623931 17566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.624339 17566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:32.624850 17254 raft_consensus.cc:504] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.625412 17547 sys_catalog.cc:564] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:32.629014 17254 leader_election.cc:288] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [CANDIDATE]: Term 1 election: Requested vote from peers 71f0d384bf1241a8bb6b8a337422804f (127.12.155.189:35799), 233ec30a952845f2b2670f3730c5250e (127.12.155.188:33615)
I20260807 19:54:32.629804 17498 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "80cff945ce834330a36f3154ec227dd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "233ec30a952845f2b2670f3730c5250e"
I20260807 19:54:32.630318 17498 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:32.633831 17498 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cff945ce834330a36f3154ec227dd1 in term 1.
I20260807 19:54:32.634831 17204 leader_election.cc:302] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 233ec30a952845f2b2670f3730c5250e, 80cff945ce834330a36f3154ec227dd1; no voters:
I20260807 19:54:32.635494 17558 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:32.647153 17558 raft_consensus.cc:686] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [term 1 LEADER]: Becoming Leader. State: Replica: 80cff945ce834330a36f3154ec227dd1, State: Running, Role: LEADER
I20260807 19:54:32.647871 17558 consensus_queue.cc:237] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
W20260807 19:54:32.648286 17579 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:54:32.648435 17579 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:54:32.635653 17172 master_runner.cc:186] Error getting master registration for 127.12.155.189:35799: OK, instance_id { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" instance_seqno: 1786132471964854 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:54:32.652412 17172 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:54:32.657864 17590 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80cff945ce834330a36f3154ec227dd1. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.658458 17590 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:32.662794 17617 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:32.665716 17617 catalog_manager.cc:1484] Initializing Kudu cluster ID...
W20260807 19:54:32.665766 17214 tablet.cc:2369] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:54:32.682644 17498 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [term 1 FOLLOWER]: Refusing update from remote peer 80cff945ce834330a36f3154ec227dd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:54:32.683986 17590 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:54:32.693619 17422 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } attempt: 5
I20260807 19:54:32.703514 17566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80cff945ce834330a36f3154ec227dd1. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.703951 17566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 19:54:32 dist-test-slave-2p8l krb5kdc[17146](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132471, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:54:32.710266 17621 mvcc.cc:205] Tried to move back new op lower bound from 7315998608089694208 to 7315998607972716544. Current Snapshot: MvccSnapshot[applied={T|T < 7315998608089694208}]
I20260807 19:54:32.713253 17626 mvcc.cc:205] Tried to move back new op lower bound from 7315998608089694208 to 7315998607972716544. Current Snapshot: MvccSnapshot[applied={T|T < 7315998608089694208}]
I20260807 19:54:32.721521 17427 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.694869 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:33615 (local address 127.0.0.1:53586)
0807 19:54:32.695121 (+ 252us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:32.695152 (+ 31us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:32.695270 (+ 118us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:32.695870 (+ 600us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:32.695876 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:32.696402 (+ 526us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:32.696619 (+ 217us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.696632 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.698232 (+ 1600us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.698238 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.699668 (+ 1430us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:32.699684 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.701159 (+ 1475us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.701165 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:32.701402 (+ 237us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.702505 (+ 1103us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:32.702532 (+ 27us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:32.706640 (+ 4108us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:32.713355 (+ 6715us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.713362 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.713366 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.714290 (+ 924us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.715151 (+ 861us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:32.715156 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:32.715160 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:32.715500 (+ 340us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:32.717141 (+ 1641us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:32.717169 (+ 28us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:32.717480 (+ 311us) client_negotiation.cc:769] Sending connection context
0807 19:54:32.717734 (+ 254us) client_negotiation.cc:240] Negotiation successful
0807 19:54:32.718295 (+ 561us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":135}
I20260807 19:54:32.721841 17558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.722674 17558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:32.723876 17617 catalog_manager.cc:1347] Generated new cluster ID: 2e94f63d2af142a984b7b0d378dc3ad7
I20260807 19:54:32.724017 17617 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:32.731480 17550 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.694448 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53586 (local address 127.12.155.188:33615)
0807 19:54:32.694671 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.694678 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.695398 (+ 720us) server_negotiation.cc:407] Connection header received
0807 19:54:32.695478 (+ 80us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.695486 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.695567 (+ 81us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.695662 (+ 95us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.696838 (+ 1176us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.697988 (+ 1150us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.699907 (+ 1919us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.700680 (+ 773us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.700812 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.706940 (+ 6128us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.706948 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.706955 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.706994 (+ 39us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.713048 (+ 6054us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.714583 (+ 1535us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.714594 (+ 11us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.714601 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.714877 (+ 276us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.715774 (+ 897us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.715780 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.715784 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.716648 (+ 864us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.719683 (+ 3035us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.721672 (+ 1989us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.725646 (+ 3974us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":71}
I20260807 19:54:32.740957 17422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: Bootstrap starting.
I20260807 19:54:32.751947 17566 sys_catalog.cc:455] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.752293 17566 sys_catalog.cc:458] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:32.758450 17422 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:32.760365 17422 log.cc:824] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:32.764950 17630 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
I20260807 19:54:32.768450 17551 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.656237 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52926 (local address 127.12.155.190:40111)
0807 19:54:32.656431 (+ 194us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.656437 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.669814 (+ 13377us) server_negotiation.cc:407] Connection header received
0807 19:54:32.670307 (+ 493us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.670314 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.670402 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.670484 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.679049 (+ 8565us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.680302 (+ 1253us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.692404 (+ 12102us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.693113 (+ 709us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.693243 (+ 130us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.746071 (+ 52828us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.746080 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.746088 (+ 8us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.746136 (+ 48us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.750382 (+ 4246us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.757253 (+ 6871us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.757260 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.757264 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.757448 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.761371 (+ 3923us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.761377 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.761380 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.761866 (+ 486us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.762165 (+ 299us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.765722 (+ 3557us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.765996 (+ 274us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":3,"server-negotiator.queue_time_us":71}
I20260807 19:54:32.771687 17422 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: No bootstrap required, opened a new log
I20260807 19:54:32.784757 17422 raft_consensus.cc:348] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.785537 17422 raft_consensus.cc:729] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 71f0d384bf1241a8bb6b8a337422804f, State: Initialized, Role: FOLLOWER
I20260807 19:54:32.786445 17422 consensus_queue.cc:260] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } }
I20260807 19:54:32.786919 17617 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:32.790982 17617 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:32.772248 17433 master_runner.cc:186] Error getting master registration for 127.12.155.189:35799: OK, instance_id { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" instance_seqno: 1786132471964854 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:54:32.802281 17422 sys_catalog.cc:564] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:32.802733 17383 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:32.803962 17433 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:54:32.806842 17383 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [term 1 FOLLOWER]: Refusing update from remote peer 80cff945ce834330a36f3154ec227dd1: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:54:32.807919 17590 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:54:32.802527 17384 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "80cff945ce834330a36f3154ec227dd1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "71f0d384bf1241a8bb6b8a337422804f"
I20260807 19:54:32.812120 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.668461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43218 (local address 127.12.155.189:35799)
0807 19:54:32.668673 (+ 212us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.668680 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.683152 (+ 14472us) server_negotiation.cc:407] Connection header received
0807 19:54:32.683939 (+ 787us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.683947 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.684040 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.684120 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.728517 (+ 44397us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.729706 (+ 1189us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.743047 (+ 13341us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.743796 (+ 749us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.743914 (+ 118us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.792455 (+ 48541us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.792463 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.792468 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.792524 (+ 56us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.796665 (+ 4141us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.804414 (+ 7749us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.804421 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.804424 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.804646 (+ 222us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.805148 (+ 502us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.805156 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.805161 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.805594 (+ 433us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.805838 (+ 244us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.811428 (+ 5590us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.811721 (+ 293us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:54:32.812606 17384 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 80cff945ce834330a36f3154ec227dd1 in term 1.
I20260807 19:54:32.801352 17637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.813803 17637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:32.816768 17553 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.681248 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53572 (local address 127.12.155.188:33615)
0807 19:54:32.681461 (+ 213us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.681467 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.719603 (+ 38136us) server_negotiation.cc:407] Connection header received
0807 19:54:32.721810 (+ 2207us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.721816 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.721901 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.721979 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.738901 (+ 16922us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.740034 (+ 1133us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.759266 (+ 19232us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.760011 (+ 745us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.760127 (+ 116us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.806467 (+ 46340us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:32.806477 (+ 10us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:32.806482 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:32.806531 (+ 49us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:32.810333 (+ 3802us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.814187 (+ 3854us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.814193 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.814197 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.814350 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:32.814892 (+ 542us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:32.814897 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:32.814900 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:32.815309 (+ 409us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:32.815565 (+ 256us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.816155 (+ 590us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.816422 (+ 267us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":73}
I20260807 19:54:32.824102 17617 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1: Generated new TSK 0
I20260807 19:54:32.825331 17617 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:32.842339 17641 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.842772 17641 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:32.843358 17637 sys_catalog.cc:455] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: SysCatalogTable state changed. Reason: New leader 80cff945ce834330a36f3154ec227dd1. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.843767 17637 sys_catalog.cc:458] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:32.846094 17558 sys_catalog.cc:455] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "80cff945ce834330a36f3154ec227dd1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "80cff945ce834330a36f3154ec227dd1" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 40111 } } peers { permanent_uuid: "71f0d384bf1241a8bb6b8a337422804f" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 35799 } } peers { permanent_uuid: "233ec30a952845f2b2670f3730c5250e" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 33615 } } }
I20260807 19:54:32.846570 17558 sys_catalog.cc:458] T 00000000000000000000000000000000 P 80cff945ce834330a36f3154ec227dd1 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:32.870103 17660 catalog_manager.cc:1259] Loaded cluster ID: 2e94f63d2af142a984b7b0d378dc3ad7
I20260807 19:54:32.870224 17660 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: loading cluster ID for follower catalog manager: success
I20260807 19:54:32.874250 17660 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: acquiring CA information for follower catalog manager: success
I20260807 19:54:32.876884 17660 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 71f0d384bf1241a8bb6b8a337422804f: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
W20260807 19:54:32.921806 17551 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:32.919045 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52932 (local address 127.12.155.190:40111)
0807 19:54:32.919279 (+ 234us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.919285 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.919839 (+ 554us) server_negotiation.cc:407] Connection header received
0807 19:54:32.920162 (+ 323us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.920169 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.920254 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.920340 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.921533 (+ 1193us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:52932: BlockingRecv error: recv got EOF from 127.0.0.1:52932 (error 108)
Metrics: {"server-negotiator.queue_time_us":63}
W20260807 19:54:32.924151 17430 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:32.920347 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43224 (local address 127.12.155.189:35799)
0807 19:54:32.920585 (+ 238us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.920593 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.922468 (+ 1875us) server_negotiation.cc:407] Connection header received
0807 19:54:32.922743 (+ 275us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.922749 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.922833 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.922911 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.923908 (+ 997us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:43224: BlockingRecv error: recv got EOF from 127.0.0.1:43224 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 19:54:32.927412 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:32.925277 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53592 (local address 127.12.155.188:33615)
0807 19:54:32.925441 (+ 164us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.925446 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.925738 (+ 292us) server_negotiation.cc:407] Connection header received
0807 19:54:32.925883 (+ 145us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.925890 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.925983 (+ 93us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.926158 (+ 175us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.927130 (+ 972us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53592: BlockingRecv error: recv got EOF from 127.0.0.1:53592 (error 108)
Metrics: {"server-negotiator.queue_time_us":54}
I20260807 19:54:32.941721 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.932906 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43228 (local address 127.12.155.189:35799)
0807 19:54:32.933090 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.933097 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.933576 (+ 479us) server_negotiation.cc:407] Connection header received
0807 19:54:32.933775 (+ 199us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.933781 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.934036 (+ 255us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.934244 (+ 208us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:32.934961 (+ 717us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.936133 (+ 1172us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.938337 (+ 2204us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.939033 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.939164 (+ 131us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.939830 (+ 666us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:32.940585 (+ 755us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:32.940729 (+ 144us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.940968 (+ 239us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.941319 (+ 351us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":62}
W20260807 19:54:32.957098 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:32.949656 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53608 (local address 127.12.155.188:33615)
0807 19:54:32.949879 (+ 223us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.949885 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.955352 (+ 5467us) server_negotiation.cc:407] Connection header received
0807 19:54:32.955625 (+ 273us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.955631 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.955769 (+ 138us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.955885 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:32.956830 (+ 945us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53608: BlockingRecv error: recv got EOF from 127.0.0.1:53608 (error 108)
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:54:32.969133 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:32.961723 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43244 (local address 127.12.155.189:35799)
0807 19:54:32.961921 (+ 198us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:32.961927 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:32.962468 (+ 541us) server_negotiation.cc:407] Connection header received
0807 19:54:32.962657 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:32.962664 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:32.962784 (+ 120us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:32.962906 (+ 122us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:32.963369 (+ 463us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.964690 (+ 1321us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.966774 (+ 2084us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:32.967495 (+ 721us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:32.967643 (+ 148us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:32.968248 (+ 605us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:32.968407 (+ 159us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:32.968507 (+ 100us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:32.968695 (+ 188us) server_negotiation.cc:299] Negotiation successful
0807 19:54:32.968779 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":60}
W20260807 19:54:33.007891 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.005415 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53622 (local address 127.12.155.188:33615)
0807 19:54:33.005621 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.005628 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.006140 (+ 512us) server_negotiation.cc:407] Connection header received
0807 19:54:33.006430 (+ 290us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.006438 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.006536 (+ 98us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.006613 (+ 77us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.007626 (+ 1013us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53622: BlockingRecv error: recv got EOF from 127.0.0.1:53622 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:54:33.019697 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.013662 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43258 (local address 127.12.155.189:35799)
0807 19:54:33.013894 (+ 232us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.013902 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.014446 (+ 544us) server_negotiation.cc:407] Connection header received
0807 19:54:33.014647 (+ 201us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.014657 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.014723 (+ 66us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.014825 (+ 102us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.015251 (+ 426us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.016098 (+ 847us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.017647 (+ 1549us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.018186 (+ 539us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.018343 (+ 157us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.018813 (+ 470us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.018959 (+ 146us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.019067 (+ 108us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.019269 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.019353 (+ 84us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 19:54:33.032153 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.026288 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53630 (local address 127.12.155.188:33615)
0807 19:54:33.026497 (+ 209us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.026501 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.030730 (+ 4229us) server_negotiation.cc:407] Connection header received
0807 19:54:33.030961 (+ 231us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.030967 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.031075 (+ 108us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.031182 (+ 107us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.031966 (+ 784us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53630: BlockingRecv error: recv got EOF from 127.0.0.1:53630 (error 108)
Metrics: {"server-negotiator.queue_time_us":104}
I20260807 19:54:33.045658 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.039855 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43272 (local address 127.12.155.189:35799)
0807 19:54:33.040152 (+ 297us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.040162 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.040685 (+ 523us) server_negotiation.cc:407] Connection header received
0807 19:54:33.040894 (+ 209us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.040900 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.040979 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.041079 (+ 100us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.041512 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.042398 (+ 886us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.043762 (+ 1364us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.044280 (+ 518us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.044427 (+ 147us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.044857 (+ 430us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.044976 (+ 119us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.045090 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.045252 (+ 162us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.045337 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":140}
W20260807 19:54:33.064157 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.058753 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53636 (local address 127.12.155.188:33615)
0807 19:54:33.059126 (+ 373us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.059135 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.062664 (+ 3529us) server_negotiation.cc:407] Connection header received
0807 19:54:33.062887 (+ 223us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.062899 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.062974 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.063090 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.063883 (+ 793us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53636: BlockingRecv error: recv got EOF from 127.0.0.1:53636 (error 108)
Metrics: {"server-negotiator.queue_time_us":205}
I20260807 19:54:33.085641 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.079507 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43286 (local address 127.12.155.189:35799)
0807 19:54:33.079722 (+ 215us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.079731 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.080339 (+ 608us) server_negotiation.cc:407] Connection header received
0807 19:54:33.080581 (+ 242us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.080585 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.080654 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.080766 (+ 112us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.081342 (+ 576us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.082203 (+ 861us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.083588 (+ 1385us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.084087 (+ 499us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.084230 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.084787 (+ 557us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.084895 (+ 108us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.085009 (+ 114us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.085167 (+ 158us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.085252 (+ 85us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":67}
W20260807 19:54:33.094924 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.092637 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53646 (local address 127.12.155.188:33615)
0807 19:54:33.092887 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.092896 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.093388 (+ 492us) server_negotiation.cc:407] Connection header received
0807 19:54:33.093670 (+ 282us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.093682 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.093754 (+ 72us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.093865 (+ 111us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.094699 (+ 834us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53646: BlockingRecv error: recv got EOF from 127.0.0.1:53646 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:54:33.123674 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.117668 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43298 (local address 127.12.155.189:35799)
0807 19:54:33.117899 (+ 231us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.117909 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.118522 (+ 613us) server_negotiation.cc:407] Connection header received
0807 19:54:33.118767 (+ 245us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.118771 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.118842 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.118984 (+ 142us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.119558 (+ 574us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.120380 (+ 822us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.121723 (+ 1343us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.122214 (+ 491us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.122354 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.122828 (+ 474us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.122969 (+ 141us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.123076 (+ 107us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.123244 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.123338 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
W20260807 19:54:33.137893 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.135508 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53650 (local address 127.12.155.188:33615)
0807 19:54:33.135764 (+ 256us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.135773 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.136348 (+ 575us) server_negotiation.cc:407] Connection header received
0807 19:54:33.136577 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.136583 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.136683 (+ 100us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.136802 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.137617 (+ 815us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53650: BlockingRecv error: recv got EOF from 127.0.0.1:53650 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:54:33.179577 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.173432 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43314 (local address 127.12.155.189:35799)
0807 19:54:33.173725 (+ 293us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.173735 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.174353 (+ 618us) server_negotiation.cc:407] Connection header received
0807 19:54:33.174618 (+ 265us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.174628 (+ 10us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.174701 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.174809 (+ 108us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.175253 (+ 444us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.176005 (+ 752us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.177567 (+ 1562us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.178192 (+ 625us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.178331 (+ 139us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.178734 (+ 403us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.178847 (+ 113us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.178953 (+ 106us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.179121 (+ 168us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.179214 (+ 93us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":77}
W20260807 19:54:33.188694 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.186341 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53666 (local address 127.12.155.188:33615)
0807 19:54:33.186524 (+ 183us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.186529 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.187141 (+ 612us) server_negotiation.cc:407] Connection header received
0807 19:54:33.187393 (+ 252us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.187399 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.187540 (+ 141us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.187667 (+ 127us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.188455 (+ 788us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53666: BlockingRecv error: recv got EOF from 127.0.0.1:53666 (error 108)
Metrics: {"server-negotiator.queue_time_us":42}
I20260807 19:54:33.262475 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.256675 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43328 (local address 127.12.155.189:35799)
0807 19:54:33.256959 (+ 284us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.256969 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.257482 (+ 513us) server_negotiation.cc:407] Connection header received
0807 19:54:33.257730 (+ 248us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.257735 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.257804 (+ 69us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.257913 (+ 109us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.258394 (+ 481us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.259325 (+ 931us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.260663 (+ 1338us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.261116 (+ 453us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.261261 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.261675 (+ 414us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.261777 (+ 102us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.261889 (+ 112us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.262042 (+ 153us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.262144 (+ 102us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":108}
W20260807 19:54:33.272037 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.269129 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53676 (local address 127.12.155.188:33615)
0807 19:54:33.269365 (+ 236us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.269374 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.270588 (+ 1214us) server_negotiation.cc:407] Connection header received
0807 19:54:33.270815 (+ 227us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.270820 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.270905 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.271015 (+ 110us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.271815 (+ 800us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53676: BlockingRecv error: recv got EOF from 127.0.0.1:53676 (error 108)
Metrics: {"server-negotiator.queue_time_us":77}
I20260807 19:54:33.411760 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.405418 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43330 (local address 127.12.155.189:35799)
0807 19:54:33.405729 (+ 311us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.405736 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.406150 (+ 414us) server_negotiation.cc:407] Connection header received
0807 19:54:33.406339 (+ 189us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.406343 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.406414 (+ 71us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.406500 (+ 86us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.406974 (+ 474us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.407729 (+ 755us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.409821 (+ 2092us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.410344 (+ 523us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.410444 (+ 100us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.410947 (+ 503us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.411077 (+ 130us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.411149 (+ 72us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.411338 (+ 189us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.411410 (+ 72us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":103}
W20260807 19:54:33.420835 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.418707 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53692 (local address 127.12.155.188:33615)
0807 19:54:33.418909 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.418915 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.419441 (+ 526us) server_negotiation.cc:407] Connection header received
0807 19:54:33.419610 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.419614 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.419689 (+ 75us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.419771 (+ 82us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.420635 (+ 864us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53692: BlockingRecv error: recv got EOF from 127.0.0.1:53692 (error 108)
Metrics: {"server-negotiator.queue_time_us":76}
I20260807 19:54:33.692531 17430 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:33.687255 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43346 (local address 127.12.155.189:35799)
0807 19:54:33.687505 (+ 250us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.687511 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.687808 (+ 297us) server_negotiation.cc:407] Connection header received
0807 19:54:33.688006 (+ 198us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.688011 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.688084 (+ 73us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.688171 (+ 87us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:33.688586 (+ 415us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.689309 (+ 723us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.690672 (+ 1363us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:33.691136 (+ 464us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:33.691247 (+ 111us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:33.691711 (+ 464us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:33.691823 (+ 112us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:33.691894 (+ 71us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:33.692096 (+ 202us) server_negotiation.cc:299] Negotiation successful
0807 19:54:33.692166 (+ 70us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":83}
W20260807 19:54:33.700441 17553 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:33.698442 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53706 (local address 127.12.155.188:33615)
0807 19:54:33.698668 (+ 226us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:33.698674 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:33.698848 (+ 174us) server_negotiation.cc:407] Connection header received
0807 19:54:33.699099 (+ 251us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:33.699104 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:33.699178 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:33.699294 (+ 116us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:33.700186 (+ 892us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:53706: BlockingRecv error: recv got EOF from 127.0.0.1:53706 (error 108)
Metrics: {"server-negotiator.queue_time_us":72}
I20260807 19:54:33.769618 17630 catalog_manager.cc:1259] Loaded cluster ID: 2e94f63d2af142a984b7b0d378dc3ad7
I20260807 19:54:33.769788 17630 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: loading cluster ID for follower catalog manager: success
I20260807 19:54:33.772468 17630 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: acquiring CA information for follower catalog manager: success
I20260807 19:54:33.774451 17630 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 233ec30a952845f2b2670f3730c5250e: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:54:34.223404 17875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:34.217030 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43354 (local address 127.12.155.189:35799)
0807 19:54:34.217571 (+ 541us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:34.217580 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:34.217705 (+ 125us) server_negotiation.cc:407] Connection header received
0807 19:54:34.217982 (+ 277us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:34.217987 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:34.218106 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:34.218245 (+ 139us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:34.218833 (+ 588us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.220039 (+ 1206us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.221518 (+ 1479us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.221970 (+ 452us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.222165 (+ 195us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:34.222592 (+ 427us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:34.222712 (+ 120us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:34.222823 (+ 111us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:34.222995 (+ 172us) server_negotiation.cc:299] Negotiation successful
0807 19:54:34.223081 (+ 86us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":417,"thread_start_us":276,"threads_started":1}
I20260807 19:54:34.235781 17885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:34.229332 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53720 (local address 127.12.155.188:33615)
0807 19:54:34.230256 (+ 924us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:34.230261 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:34.230278 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:54:34.230341 (+ 63us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:34.230344 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:34.230510 (+ 166us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:34.230666 (+ 156us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:34.231127 (+ 461us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.231878 (+ 751us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.233363 (+ 1485us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.233831 (+ 468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.233983 (+ 152us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:34.234564 (+ 581us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:34.235117 (+ 553us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:34.235319 (+ 202us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:34.235376 (+ 57us) server_negotiation.cc:299] Negotiation successful
0807 19:54:34.235465 (+ 89us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":803,"thread_start_us":653,"threads_started":1}
I20260807 19:54:34.250788 17875 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:34.243422 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:43366 (local address 127.12.155.189:35799)
0807 19:54:34.243675 (+ 253us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:34.243682 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:34.244007 (+ 325us) server_negotiation.cc:407] Connection header received
0807 19:54:34.244333 (+ 326us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:34.244342 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:34.244463 (+ 121us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:34.244528 (+ 65us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:34.245314 (+ 786us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.246207 (+ 893us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.248595 (+ 2388us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.249280 (+ 685us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.249425 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:34.249929 (+ 504us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:34.250105 (+ 176us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:34.250203 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:34.250390 (+ 187us) server_negotiation.cc:299] Negotiation successful
0807 19:54:34.250481 (+ 91us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":75}
I20260807 19:54:34.251466 17896 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:34.242702 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:52948 (local address 127.12.155.190:40111)
0807 19:54:34.243235 (+ 533us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:34.243244 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:34.243409 (+ 165us) server_negotiation.cc:407] Connection header received
0807 19:54:34.243721 (+ 312us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:34.243727 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:34.243969 (+ 242us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:34.244153 (+ 184us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:34.245058 (+ 905us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.245889 (+ 831us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.248339 (+ 2450us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.249004 (+ 665us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.249121 (+ 117us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:34.249857 (+ 736us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:34.250320 (+ 463us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:34.250418 (+ 98us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:34.251061 (+ 643us) server_negotiation.cc:299] Negotiation successful
0807 19:54:34.251160 (+ 99us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":402,"thread_start_us":279,"threads_started":1}
I20260807 19:54:34.252722 17885 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:34.244078 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:53732 (local address 127.12.155.188:33615)
0807 19:54:34.244262 (+ 184us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:34.244268 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:34.244942 (+ 674us) server_negotiation.cc:407] Connection header received
0807 19:54:34.246043 (+ 1101us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:34.246047 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:34.246178 (+ 131us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:34.246277 (+ 99us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:34.246945 (+ 668us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.247641 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.249640 (+ 1999us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:34.250435 (+ 795us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:34.250563 (+ 128us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:34.251996 (+ 1433us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:34.252146 (+ 150us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:34.252248 (+ 102us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:34.252426 (+ 178us) server_negotiation.cc:299] Negotiation successful
0807 19:54:34.252513 (+ 87us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:54:34.256920 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17172
I20260807 19:54:34.258142 17282 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:34.369457 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17172
I20260807 19:54:34.401508 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17302
I20260807 19:54:34.402871 17414 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:34.511191 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17302
I20260807 19:54:34.539866 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17433
I20260807 19:54:34.541126 17538 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:34.649091 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17433
2026-08-07T19:54:34Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/0 (5424 ms)
[ RUN ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1
Loading random data
Initializing database '/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/principal' for realm 'KRBTEST.COM',
master key name 'K/M@KRBTEST.COM'
Aug 07 19:54:34 dist-test-slave-2p8l krb5kdc[17907](info): setting up network...
krb5kdc: setsockopt(10,IPV6_V6ONLY,1) worked
Aug 07 19:54:34 dist-test-slave-2p8l krb5kdc[17907](info): set up 2 sockets
Aug 07 19:54:34 dist-test-slave-2p8l krb5kdc[17907](info): commencing operation
krb5kdc: starting...
W20260807 19:54:36.024326 12910 mini_kdc.cc:121] Time spent starting KDC: real 1.326s user 0.003s sys 0.044s
WARNING: no policy specified for test-admin@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-admin@KRBTEST.COM" created.
WARNING: no policy specified for test-user@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "test-user@KRBTEST.COM" created.
WARNING: no policy specified for joe-interloper@KRBTEST.COM; defaulting to no policy
Authenticating as principal slave/admin@KRBTEST.COM with password.
Principal "joe-interloper@KRBTEST.COM" created.
Authenticating as principal slave/admin@KRBTEST.COM with password.
Entry for principal test-user with kvno 1, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Entry for principal test-user with kvno 1, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/test-user.keytab.
Aug 07 19:54:36 dist-test-slave-2p8l krb5kdc[17907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
Password for test-admin@KRBTEST.COM:
2026-08-07T19:54:36Z chronyd version 3.5 starting (+CMDMON +NTP +REFCLOCK +RTC -PRIVDROP -SCFILTER -SIGND +ASYNCDNS -SECHASH -IPV6 +DEBUG)
2026-08-07T19:54:36Z Disabled control of system clock
WARNING: no policy specified for kudu/127.12.155.190@KRBTEST.COM; defaulting to no policy
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.190@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
Entry for principal kudu/127.12.155.190 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab.
I20260807 19:54:36.363731 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:46849
--webserver_interface=127.12.155.190
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:46849,127.12.155.189:40457,127.12.155.188:43815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
W20260807 19:54:36.714912 17930 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 19:54:36.715299 17930 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:36.715431 17930 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:36.715576 17930 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:36.722934 17930 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:36.723021 17930 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:36.723142 17930 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:36.723232 17930 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:36.723354 17930 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:36.733286 17930 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:46849,127.12.155.189:40457,127.12.155.188:43815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.190.keytab
--principal=kudu/127.12.155.190
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.190:46849
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
--webserver_interface=127.12.155.190
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:36.734668 17930 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:36.736021 17930 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:36.748158 17939 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:36.748195 17943 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:36.748143 17940 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:36.749018 17930 server_base.cc:1034] running on GCE node
I20260807 19:54:36.749750 17930 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:36.751209 17930 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:36.752467 17930 hybrid_clock.cc:648] HybridClock initialized: now 1786132476752385 us; error 45 us; skew 500 ppm
I20260807 19:54:36.752842 17930 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:36 dist-test-slave-2p8l krb5kdc[17907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:36.756150 17930 init.cc:377] Logged in from keytab as kudu/127.12.155.190@KRBTEST.COM (short username kudu)
I20260807 19:54:36.757648 17930 webserver.cc:460] Webserver started at http://127.12.155.190:38901/ using document root <none> and password file <none>
I20260807 19:54:36.758445 17930 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:36.758581 17930 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:36.758912 17930 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:36.761900 17930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data/instance:
uuid: "182ef70d9334453b9fae2ae8df0f6c36"
format_stamp: "Formatted at 2026-08-07 19:54:36 on dist-test-slave-2p8l"
server_key: "16ca183b56a5804a53298d32b8a6f20f"
server_key_iv: "c1bdf71542fb6db9a9a6d746c8a6e354"
server_key_version: "encryptionkey@0"
I20260807 19:54:36.762786 17930 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal/instance:
uuid: "182ef70d9334453b9fae2ae8df0f6c36"
format_stamp: "Formatted at 2026-08-07 19:54:36 on dist-test-slave-2p8l"
server_key: "16ca183b56a5804a53298d32b8a6f20f"
server_key_iv: "c1bdf71542fb6db9a9a6d746c8a6e354"
server_key_version: "encryptionkey@0"
I20260807 19:54:36.767946 17930 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.005s sys 0.000s
I20260807 19:54:36.771476 17954 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:36.772822 17930 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:54:36.773007 17930 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal
uuid: "182ef70d9334453b9fae2ae8df0f6c36"
format_stamp: "Formatted at 2026-08-07 19:54:36 on dist-test-slave-2p8l"
server_key: "16ca183b56a5804a53298d32b8a6f20f"
server_key_iv: "c1bdf71542fb6db9a9a6d746c8a6e354"
server_key_version: "encryptionkey@0"
I20260807 19:54:36.773239 17930 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:36.794597 17930 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:36.799386 17930 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:36.799692 17930 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:36.820042 17930 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.190:46849
I20260807 19:54:36.820068 18049 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.190:46849 every 8 connection(s)
I20260807 19:54:36.821487 17930 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/data/info.pb
I20260807 19:54:36.825537 18050 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:36.829300 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 17930
I20260807 19:54:36.829494 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-0/wal/instance
I20260807 19:54:36.830310 12910 external_mini_cluster.cc:1428] Setting key 3ce032117c8faa607903a718928cd825
I20260807 19:54:36.832976 18050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:36 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:36.858218 18054 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.836560 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58254 (local address 127.12.155.190:46849)
0807 19:54:36.838362 (+ 1802us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:36.838376 (+ 14us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:36.838434 (+ 58us) server_negotiation.cc:407] Connection header received
0807 19:54:36.840244 (+ 1810us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:36.840256 (+ 12us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:36.840577 (+ 321us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:36.840802 (+ 225us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:36.842097 (+ 1295us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:36.843986 (+ 1889us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:36.845569 (+ 1583us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:36.846265 (+ 696us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:36.846499 (+ 234us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:36.850255 (+ 3756us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:36.850264 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:36.850278 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:36.850309 (+ 31us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:36.853334 (+ 3025us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:36.854109 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:36.854121 (+ 12us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:36.854136 (+ 15us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:36.854289 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:36.854763 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:36.854770 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:36.854774 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:36.855314 (+ 540us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:36.855545 (+ 231us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:36.856143 (+ 598us) server_negotiation.cc:299] Negotiation successful
0807 19:54:36.856530 (+ 387us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":1,"server-negotiator.queue_time_us":1581,"spinlock_wait_cycles":24960,"thread_start_us":1318,"threads_started":1}
I20260807 19:54:36.858258 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.836564 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:46849 (local address 127.0.0.1:58254)
0807 19:54:36.837703 (+ 1139us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.837770 (+ 67us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:36.839844 (+ 2074us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:36.840843 (+ 999us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:36.840848 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:36.841453 (+ 605us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:36.841830 (+ 377us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:36.841859 (+ 29us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:36.844175 (+ 2316us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:36.844180 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:36.845405 (+ 1225us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:36.845418 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:36.846528 (+ 1110us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:36.846537 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:36.846752 (+ 215us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:36.847479 (+ 727us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:36.847504 (+ 25us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:36.849974 (+ 2470us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:36.853477 (+ 3503us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:36.853491 (+ 14us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:36.853505 (+ 14us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:36.853940 (+ 435us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:36.854421 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:36.854428 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:36.854431 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:36.854634 (+ 203us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:36.855479 (+ 845us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:36.855489 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:36.855739 (+ 250us) client_negotiation.cc:769] Sending connection context
0807 19:54:36.856016 (+ 277us) client_negotiation.cc:240] Negotiation successful
0807 19:54:36.856666 (+ 650us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":742,"mutex_wait_us":158,"thread_start_us":455,"threads_started":1}
I20260807 19:54:36.861747 18050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:36.862972 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.862456 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48100)
0807 19:54:36.862651 (+ 195us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.862801 (+ 150us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 19:54:36.863293 17958 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
WARNING: no policy specified for kudu/127.12.155.189@KRBTEST.COM; defaulting to no policy
I20260807 19:54:36.864938 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.864549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48106)
0807 19:54:36.864743 (+ 194us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.864812 (+ 69us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":62}
W20260807 19:54:36.865140 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40457: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.189@KRBTEST.COM" created.
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.189 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab.
Entry for principal kudu/127.12.155.189 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab.
I20260807 19:54:36.906462 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:40457
--webserver_interface=127.12.155.189
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab
--principal=kudu/127.12.155.189
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:46849,127.12.155.189:40457,127.12.155.188:43815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:54:36.914527 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } attempt: 1
I20260807 19:54:36.915814 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.915276 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48114)
0807 19:54:36.915546 (+ 270us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.915677 (+ 131us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":70}
I20260807 19:54:36.916873 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.916514 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48128)
0807 19:54:36.916666 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.916741 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":49}
W20260807 19:54:36.917068 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40457: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
I20260807 19:54:36.985366 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } attempt: 2
I20260807 19:54:36.986723 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.986218 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48136)
0807 19:54:36.986474 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.986570 (+ 96us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":79}
I20260807 19:54:36.987926 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:36.987549 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48140)
0807 19:54:36.987698 (+ 149us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:36.987785 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 19:54:36.988197 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40457: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
I20260807 19:54:37.079460 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } attempt: 3
I20260807 19:54:37.080703 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.080242 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48156)
0807 19:54:37.080463 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.080558 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":89}
I20260807 19:54:37.081856 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.081490 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48168)
0807 19:54:37.081641 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.081716 (+ 75us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":55}
W20260807 19:54:37.082159 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40457: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
I20260807 19:54:37.225432 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } attempt: 4
I20260807 19:54:37.226866 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.226270 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48184)
0807 19:54:37.226613 (+ 343us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.226711 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":190}
I20260807 19:54:37.228091 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.227704 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48198)
0807 19:54:37.227873 (+ 169us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.227960 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":59}
W20260807 19:54:37.228281 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.189:40457: Network error: Client connection negotiation failed: client connection to 127.12.155.189:40457: connect: Connection refused (error 111)
W20260807 19:54:37.282310 18064 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 19:54:37.282711 18064 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:37.282845 18064 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:37.282985 18064 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:37.290311 18064 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:37.290443 18064 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:37.290567 18064 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:37.290663 18064 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:37.290756 18064 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:37.301005 18064 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:46849,127.12.155.189:40457,127.12.155.188:43815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.189.keytab
--principal=kudu/127.12.155.189
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.189:40457
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
--webserver_interface=127.12.155.189
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:37.302373 18064 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:37.303732 18064 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:37.315819 18077 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:37.315840 18073 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:37.316017 18075 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:37.316763 18064 server_base.cc:1034] running on GCE node
I20260807 19:54:37.317498 18064 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:37.319021 18064 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:37.320286 18064 hybrid_clock.cc:648] HybridClock initialized: now 1786132477320225 us; error 34 us; skew 500 ppm
I20260807 19:54:37.320590 18064 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:37.323951 18064 init.cc:377] Logged in from keytab as kudu/127.12.155.189@KRBTEST.COM (short username kudu)
I20260807 19:54:37.325444 18064 webserver.cc:460] Webserver started at http://127.12.155.189:34337/ using document root <none> and password file <none>
I20260807 19:54:37.326185 18064 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:37.326280 18064 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:37.326566 18064 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:37.329487 18064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data/instance:
uuid: "082138f5cc744b49bfcc1c5c83f7ceef"
format_stamp: "Formatted at 2026-08-07 19:54:37 on dist-test-slave-2p8l"
server_key: "4b2dde7e20c3adccb8c5450b2f15ae70"
server_key_iv: "9ba21f30dd0f51c806920fcb5943a224"
server_key_version: "encryptionkey@0"
I20260807 19:54:37.330336 18064 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal/instance:
uuid: "082138f5cc744b49bfcc1c5c83f7ceef"
format_stamp: "Formatted at 2026-08-07 19:54:37 on dist-test-slave-2p8l"
server_key: "4b2dde7e20c3adccb8c5450b2f15ae70"
server_key_iv: "9ba21f30dd0f51c806920fcb5943a224"
server_key_version: "encryptionkey@0"
I20260807 19:54:37.335529 18064 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20260807 19:54:37.338995 18089 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:37.340371 18064 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.004s sys 0.000s
I20260807 19:54:37.340562 18064 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal
uuid: "082138f5cc744b49bfcc1c5c83f7ceef"
format_stamp: "Formatted at 2026-08-07 19:54:37 on dist-test-slave-2p8l"
server_key: "4b2dde7e20c3adccb8c5450b2f15ae70"
server_key_iv: "9ba21f30dd0f51c806920fcb5943a224"
server_key_version: "encryptionkey@0"
I20260807 19:54:37.340776 18064 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:37.372939 18064 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:37.377697 18064 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:37.378010 18064 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:37.397012 18064 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.189:40457
I20260807 19:54:37.397033 18178 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.189:40457 every 8 connection(s)
I20260807 19:54:37.398506 18064 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/data/info.pb
I20260807 19:54:37.400561 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18064
I20260807 19:54:37.400771 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-1/wal/instance
I20260807 19:54:37.401242 12910 external_mini_cluster.cc:1428] Setting key 6107f4540ae987e692ef6f21053f845a
I20260807 19:54:37.402884 18180 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:37.409430 18180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:37.433907 18183 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.412106 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58264 (local address 127.12.155.190:46849)
0807 19:54:37.418494 (+ 6388us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.418498 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.418515 (+ 17us) server_negotiation.cc:407] Connection header received
0807 19:54:37.418568 (+ 53us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.418571 (+ 3us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.418641 (+ 70us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.418772 (+ 131us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:37.420369 (+ 1597us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.421099 (+ 730us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.422707 (+ 1608us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.423124 (+ 417us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.423269 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.427243 (+ 3974us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:37.427249 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:37.427252 (+ 3us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:37.427297 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:37.430352 (+ 3055us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.431429 (+ 1077us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.431433 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.431435 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.431552 (+ 117us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.432077 (+ 525us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.432080 (+ 3us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.432082 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.432364 (+ 282us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:37.432477 (+ 113us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:37.433461 (+ 984us) server_negotiation.cc:299] Negotiation successful
0807 19:54:37.433623 (+ 162us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6263,"thread_start_us":6142,"threads_started":1}
WARNING: no policy specified for kudu/127.12.155.188@KRBTEST.COM; defaulting to no policy
I20260807 19:54:37.435282 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.412833 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:46849 (local address 127.0.0.1:58264)
0807 19:54:37.416139 (+ 3306us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.416210 (+ 71us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:37.417991 (+ 1781us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:37.419019 (+ 1028us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:37.419028 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:37.419558 (+ 530us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:37.420137 (+ 579us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.420155 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.421279 (+ 1124us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.421284 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.422549 (+ 1265us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.422562 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.423376 (+ 814us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.423383 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.423627 (+ 244us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.424351 (+ 724us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:37.424374 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:37.426983 (+ 2609us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:37.430509 (+ 3526us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.430522 (+ 13us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.430544 (+ 22us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.431291 (+ 747us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.431676 (+ 385us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.431684 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.431701 (+ 17us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.431956 (+ 255us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.432511 (+ 555us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:37.432521 (+ 10us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:37.433016 (+ 495us) client_negotiation.cc:769] Sending connection context
0807 19:54:37.433377 (+ 361us) client_negotiation.cc:240] Negotiation successful
0807 19:54:37.433970 (+ 593us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":2946,"thread_start_us":2681,"threads_started":1}
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Principal "kudu/127.12.155.188@KRBTEST.COM" created.
I20260807 19:54:37.437260 18180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:37.452375 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.438283 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48208)
0807 19:54:37.438450 (+ 167us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.438471 (+ 21us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:37.438596 (+ 125us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:37.439291 (+ 695us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:37.439295 (+ 4us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:37.439746 (+ 451us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:37.439877 (+ 131us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.439885 (+ 8us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.441233 (+ 1348us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.441239 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.442153 (+ 914us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.442170 (+ 17us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.442965 (+ 795us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.442970 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.443205 (+ 235us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.443835 (+ 630us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:37.443851 (+ 16us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:37.446403 (+ 2552us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:37.449719 (+ 3316us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.449727 (+ 8us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.449733 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.450309 (+ 576us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.450687 (+ 378us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.450694 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.450700 (+ 6us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.450894 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.451699 (+ 805us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:37.451702 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:37.451813 (+ 111us) client_negotiation.cc:769] Sending connection context
0807 19:54:37.451917 (+ 104us) client_negotiation.cc:240] Negotiation successful
0807 19:54:37.452106 (+ 189us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":55,"mutex_wait_us":4}
I20260807 19:54:37.452962 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.438325 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48208 (local address 127.12.155.189:40457)
0807 19:54:37.438901 (+ 576us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.438906 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.438929 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:54:37.438968 (+ 39us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.438974 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.439148 (+ 174us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.439301 (+ 153us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:37.440054 (+ 753us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.441096 (+ 1042us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.442286 (+ 1190us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.442817 (+ 531us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.442957 (+ 140us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.446627 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:37.446638 (+ 11us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:37.446651 (+ 13us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:37.446726 (+ 75us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:37.449562 (+ 2836us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.450446 (+ 884us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.450453 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.450455 (+ 2us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.450569 (+ 114us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.451046 (+ 477us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.451053 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.451059 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.451565 (+ 506us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:37.451794 (+ 229us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:37.452137 (+ 343us) server_negotiation.cc:299] Negotiation successful
0807 19:54:37.452438 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":35,"server-negotiator.queue_time_us":439,"thread_start_us":285,"threads_started":1}
I20260807 19:54:37.455782 18180 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:37.457134 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.456543 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50398)
0807 19:54:37.456798 (+ 255us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.456936 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":69}
W20260807 19:54:37.457456 18090 proxy.cc:239] Call had error, refreshing address and retrying: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.459359 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.458866 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50406)
0807 19:54:37.459073 (+ 207us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.459195 (+ 122us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":60}
W20260807 19:54:37.459652 18180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Authenticating as principal test-admin/admin@KRBTEST.COM with password.
Entry for principal kudu/127.12.155.188 with kvno 2, encryption type aes256-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab.
Entry for principal kudu/127.12.155.188 with kvno 2, encryption type aes128-cts-hmac-sha1-96 added to keytab WRFILE:/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab.
I20260807 19:54:37.477960 12910 external_mini_cluster.cc:1326] Running /tmp/dist-test-taskviQnk1/build/asan/bin/kudu
/tmp/dist-test-taskviQnk1/build/asan/bin/kudu
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data
--block_manager=log
--webserver_interface=localhost
--never_fsync
--enable_minidumps=false
--redact=none
--metrics_log_interval_ms=1000
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/logs
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--server_dump_info_format=pb
--rpc_server_allow_ephemeral_ports
--unlock_experimental_flags
--unlock_unsafe_flags
--logtostderr
--logbuflevel=-1
--ipki_server_key_size=768
--openssl_security_level_override=0
master
run
--ipki_ca_key_size=768
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:43815
--webserver_interface=127.12.155.188
--webserver_port=0
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab
--principal=kudu/127.12.155.188
--rpc_authentication=required
--superuser_acl=test-admin
--user_acl=test-user
--builtin_ntp_servers=127.12.155.148:43113
--builtin_ntp_poll_interval_ms=100
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--rpc_reuseport=true
--master_addresses=127.12.155.190:46849,127.12.155.189:40457,127.12.155.188:43815
--encrypt_data_at_rest=true
--rpc_trace_negotiation
--enable_leader_failure_detection=false
--rpc_authentication=required
--rpc_encryption=required with env {KRB5CCNAME=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/krb5cc,KRB5_CONFIG=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/krb5.conf,KRB5_KDC_PROFILE=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kdc.conf,KUDU_ENABLE_KRB5_REALM_FIX=yes}
I20260807 19:54:37.508980 18180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 1
I20260807 19:54:37.510322 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.509778 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50420)
0807 19:54:37.509993 (+ 215us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.510168 (+ 175us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":80}
I20260807 19:54:37.511369 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.511014 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50422)
0807 19:54:37.511201 (+ 187us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.511271 (+ 70us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 19:54:37.511600 18180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.527506 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } attempt: 5
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:37.544098 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.528306 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48212)
0807 19:54:37.528525 (+ 219us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.528545 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:37.528696 (+ 151us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:37.529057 (+ 361us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:37.529063 (+ 6us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:37.529486 (+ 423us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:37.529677 (+ 191us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.529687 (+ 10us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.530937 (+ 1250us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.530944 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.532456 (+ 1512us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.532474 (+ 18us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.533297 (+ 823us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.533304 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.533523 (+ 219us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.534425 (+ 902us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:37.534457 (+ 32us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:37.536941 (+ 2484us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:37.541296 (+ 4355us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.541301 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.541304 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.541726 (+ 422us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.542259 (+ 533us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.542263 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.542265 (+ 2us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.542407 (+ 142us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.543176 (+ 769us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:37.543179 (+ 3us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:37.543413 (+ 234us) client_negotiation.cc:769] Sending connection context
0807 19:54:37.543585 (+ 172us) client_negotiation.cc:240] Negotiation successful
0807 19:54:37.543844 (+ 259us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":71}
I20260807 19:54:37.544481 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.528384 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48212 (local address 127.12.155.189:40457)
0807 19:54:37.528576 (+ 192us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.528584 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.528608 (+ 24us) server_negotiation.cc:407] Connection header received
0807 19:54:37.528845 (+ 237us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.528849 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.528914 (+ 65us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.529022 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:37.529848 (+ 826us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.530765 (+ 917us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.532664 (+ 1899us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.533120 (+ 456us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.533223 (+ 103us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.537180 (+ 3957us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:37.537187 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:37.537192 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:37.537238 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:37.541098 (+ 3860us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.541873 (+ 775us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.541881 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.541887 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.542127 (+ 240us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.542536 (+ 409us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.542544 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.542549 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.543017 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:37.543203 (+ 186us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:37.543753 (+ 550us) server_negotiation.cc:299] Negotiation successful
0807 19:54:37.544065 (+ 312us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":69}
I20260807 19:54:37.545553 18050 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:37.546804 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.546402 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50424)
0807 19:54:37.546580 (+ 178us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.546674 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":61}
I20260807 19:54:37.547792 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.547446 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50430)
0807 19:54:37.547597 (+ 151us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.547684 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":50}
W20260807 19:54:37.548018 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.579852 18180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 2
I20260807 19:54:37.581053 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.580551 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50438)
0807 19:54:37.580797 (+ 246us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.580888 (+ 91us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":105}
I20260807 19:54:37.582127 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.581713 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50446)
0807 19:54:37.581865 (+ 152us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.581939 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":51}
W20260807 19:54:37.582343 18180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.599236 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 1
I20260807 19:54:37.600509 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.599916 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50456)
0807 19:54:37.600172 (+ 256us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.600292 (+ 120us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":87}
I20260807 19:54:37.601675 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.601288 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50470)
0807 19:54:37.601449 (+ 161us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.601539 (+ 90us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":53}
W20260807 19:54:37.601903 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.670188 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 2
I20260807 19:54:37.671686 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.670980 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50472)
0807 19:54:37.671311 (+ 331us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.671449 (+ 138us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":100}
I20260807 19:54:37.673017 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.672593 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50478)
0807 19:54:37.672767 (+ 174us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.672865 (+ 98us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":63}
W20260807 19:54:37.673333 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.673566 18180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 3
I20260807 19:54:37.674654 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.674203 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50490)
0807 19:54:37.674387 (+ 184us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.674482 (+ 95us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":58}
I20260807 19:54:37.675809 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.675354 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50506)
0807 19:54:37.675622 (+ 268us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.675696 (+ 74us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":158}
W20260807 19:54:37.676054 18180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.779578 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 3
I20260807 19:54:37.780813 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.780345 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50514)
0807 19:54:37.780553 (+ 208us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.780647 (+ 94us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":83}
I20260807 19:54:37.782038 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.781595 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50524)
0807 19:54:37.781836 (+ 241us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.781922 (+ 86us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":139}
W20260807 19:54:37.782403 18050 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
I20260807 19:54:37.819319 18180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 4
I20260807 19:54:37.820708 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.820063 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50528)
0807 19:54:37.820358 (+ 295us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.820504 (+ 146us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":88}
I20260807 19:54:37.821921 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.821471 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50530)
0807 19:54:37.821700 (+ 229us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.821787 (+ 87us) negotiation.cc:327] Negotiation complete: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
Metrics: {"client-negotiator.queue_time_us":106}
W20260807 19:54:37.822151 18180 consensus_peers.cc:646] Error getting permanent uuid from config peer 127.12.155.188:43815: Network error: Client connection negotiation failed: client connection to 127.12.155.188:43815: connect: Connection refused (error 111)
W20260807 19:54:37.838253 18195 flags.cc:425] Enabled unsafe flag: --enable_leader_failure_detection=false
W20260807 19:54:37.838621 18195 flags.cc:425] Enabled unsafe flag: --openssl_security_level_override=0
W20260807 19:54:37.838747 18195 flags.cc:425] Enabled unsafe flag: --rpc_server_allow_ephemeral_ports=true
W20260807 19:54:37.838882 18195 flags.cc:425] Enabled unsafe flag: --never_fsync=true
W20260807 19:54:37.846313 18195 flags.cc:425] Enabled experimental flag: --ipki_ca_key_size=768
W20260807 19:54:37.846436 18195 flags.cc:425] Enabled experimental flag: --rpc_trace_negotiation=true
W20260807 19:54:37.846563 18195 flags.cc:425] Enabled experimental flag: --ipki_server_key_size=768
W20260807 19:54:37.846652 18195 flags.cc:425] Enabled experimental flag: --tsk_num_rsa_bits=512
W20260807 19:54:37.846761 18195 flags.cc:425] Enabled experimental flag: --rpc_reuseport=true
I20260807 19:54:37.857173 18195 master_runner.cc:386] Master server non-default flags:
--builtin_ntp_poll_interval_ms=100
--builtin_ntp_servers=127.12.155.148:43113
--ntp_initial_sync_wait_secs=10
--time_source=builtin
--enable_leader_failure_detection=false
--fs_data_dirs=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data
--fs_wal_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal
--ipki_ca_key_size=768
--master_addresses=127.12.155.190:46849,127.12.155.189:40457,127.12.155.188:43815
--rpc_trace_negotiation=true
--keytab_file=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/krb5kdc/kudu_127.12.155.188.keytab
--principal=kudu/127.12.155.188
--ipki_server_key_size=768
--openssl_security_level_override=0
--tsk_num_rsa_bits=512
--rpc_bind_addresses=127.12.155.188:43815
--rpc_reuseport=true
--rpc_server_allow_ephemeral_ports=true
--rpc_authentication=required
--rpc_encryption=required
--superuser_acl=<redacted>
--user_acl=<redacted>
--metrics_log_interval_ms=1000
--server_dump_info_format=pb
--server_dump_info_path=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
--webserver_interface=127.12.155.188
--webserver_port=0
--encrypt_data_at_rest=true
--never_fsync=true
--redact=none
--unlock_experimental_flags=true
--unlock_unsafe_flags=true
--enable_minidumps=false
--log_dir=/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/logs
--logbuflevel=-1
--logtostderr=true
Master server version:
kudu 1.18.0-SNAPSHOT
revision c2d25d5f57d102d9ad9869eaf208d035a22e18aa
build type FASTDEBUG
built by systest at 07 Aug 2026 18:41:41 UTC on ccycloud.quasar-unxwht.root.comops.site
build id 4573426
ASAN enabled
I20260807 19:54:37.858605 18195 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20260807 19:54:37.859995 18195 file_cache.cc:493] Constructed file cache file cache with capacity 419430
W20260807 19:54:37.872323 18213 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:37.872403 18207 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20260807 19:54:37.872468 18209 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20260807 19:54:37.873454 18195 server_base.cc:1034] running on GCE node
I20260807 19:54:37.874341 18195 hybrid_clock.cc:584] initializing the hybrid clock with 'builtin' time source
I20260807 19:54:37.875725 18195 hybrid_clock.cc:630] waiting up to --ntp_initial_sync_wait_secs=10 seconds for the clock to synchronize
I20260807 19:54:37.877012 18195 hybrid_clock.cc:648] HybridClock initialized: now 1786132477876941 us; error 39 us; skew 500 ppm
I20260807 19:54:37.877401 18195 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): AS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for krbtgt/KRBTEST.COM@KRBTEST.COM
I20260807 19:54:37.880738 18195 init.cc:377] Logged in from keytab as kudu/127.12.155.188@KRBTEST.COM (short username kudu)
I20260807 19:54:37.882212 18195 webserver.cc:460] Webserver started at http://127.12.155.188:37965/ using document root <none> and password file <none>
I20260807 19:54:37.882858 18195 fs_manager.cc:359] Metadata directory not provided
I20260807 19:54:37.882946 18195 fs_manager.cc:365] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20260807 19:54:37.883229 18195 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20260807 19:54:37.886229 18195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data/instance:
uuid: "6f10f1d42d0c43acabf841dfe46ea854"
format_stamp: "Formatted at 2026-08-07 19:54:37 on dist-test-slave-2p8l"
server_key: "e19f8a9442349383d97b545ca8b047d7"
server_key_iv: "cda304c5fa1be87599aad2afa2ebb5d2"
server_key_version: "encryptionkey@0"
I20260807 19:54:37.886987 18195 fs_manager.cc:1063] Generated new instance metadata in path /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal/instance:
uuid: "6f10f1d42d0c43acabf841dfe46ea854"
format_stamp: "Formatted at 2026-08-07 19:54:37 on dist-test-slave-2p8l"
server_key: "e19f8a9442349383d97b545ca8b047d7"
server_key_iv: "cda304c5fa1be87599aad2afa2ebb5d2"
server_key_version: "encryptionkey@0"
I20260807 19:54:37.892148 18195 fs_manager.cc:691] Time spent creating directory manager: real 0.005s user 0.000s sys 0.005s
I20260807 19:54:37.895582 18225 log_block_manager.cc:3774] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20260807 19:54:37.897050 18195 fs_manager.cc:725] Time spent opening block manager: real 0.003s user 0.001s sys 0.000s
I20260807 19:54:37.897228 18195 fs_manager.cc:642] Opened local filesystem: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data,/tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal
uuid: "6f10f1d42d0c43acabf841dfe46ea854"
format_stamp: "Formatted at 2026-08-07 19:54:37 on dist-test-slave-2p8l"
server_key: "e19f8a9442349383d97b545ca8b047d7"
server_key_iv: "cda304c5fa1be87599aad2afa2ebb5d2"
server_key_version: "encryptionkey@0"
I20260807 19:54:37.897454 18195 fs_report.cc:383] FS layout report
--------------------
wal directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal
metadata directory: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal
1 data directories: /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20260807 19:54:37.926270 18195 rpc_server.cc:225] running with OpenSSL 1.0.2k-fips 26 Jan 2017
I20260807 19:54:37.930954 18195 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20260807 19:54:37.931257 18195 kserver.cc:163] Server-wide thread pool size limit: 3276
I20260807 19:54:37.951293 18195 rpc_server.cc:307] RPC server started. Bound to: 127.12.155.188:43815
I20260807 19:54:37.951314 18310 acceptor_pool.cc:254] collecting diagnostics on the listening RPC socket 127.12.155.188:43815 every 8 connection(s)
I20260807 19:54:37.952713 18195 server_base.cc:1166] Dumped server information to /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/data/info.pb
I20260807 19:54:37.956657 18311 data_dirs.cc:395] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20260807 19:54:37.959653 18050 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 4
I20260807 19:54:37.962555 12910 external_mini_cluster.cc:1388] Started /tmp/dist-test-taskviQnk1/build/asan/bin/kudu as pid 18195
I20260807 19:54:37.962769 12910 external_mini_cluster.cc:1402] Reading /tmp/dist-test-taskviQnk1/test-tmp/security-itest.0.ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys_1.1786132073392555-12910-0/minicluster-data/master-2/wal/instance
I20260807 19:54:37.963385 12910 external_mini_cluster.cc:1428] Setting key cbb5a0be681eb9a9f3517e76829a6dfd
I20260807 19:54:37.966044 18311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } has no permanent_uuid. Determining permanent_uuid...
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.190@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
I20260807 19:54:37.987442 18052 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.960352 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50544)
0807 19:54:37.960573 (+ 221us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.960596 (+ 23us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:37.960725 (+ 129us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:37.966728 (+ 6003us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:37.966737 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:37.967443 (+ 706us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:37.967745 (+ 302us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.967761 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.971421 (+ 3660us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.971430 (+ 9us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.973413 (+ 1983us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.973437 (+ 24us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.975249 (+ 1812us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.975259 (+ 10us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.975504 (+ 245us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.976261 (+ 757us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:37.976289 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:37.979344 (+ 3055us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:37.984112 (+ 4768us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.984117 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.984121 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.984727 (+ 606us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.985306 (+ 579us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.985312 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.985319 (+ 7us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.985467 (+ 148us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.986409 (+ 942us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:37.986416 (+ 7us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:37.986559 (+ 143us) client_negotiation.cc:769] Sending connection context
0807 19:54:37.986725 (+ 166us) client_negotiation.cc:240] Negotiation successful
0807 19:54:37.987047 (+ 322us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":87}
Aug 07 19:54:37 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:54:37.988853 18313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.961555 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50544 (local address 127.12.155.188:43815)
0807 19:54:37.962660 (+ 1105us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.962688 (+ 28us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.962743 (+ 55us) server_negotiation.cc:407] Connection header received
0807 19:54:37.965468 (+ 2725us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.965507 (+ 39us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.966175 (+ 668us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.968061 (+ 1886us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:37.968706 (+ 645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.971174 (+ 2468us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.973685 (+ 2511us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.975034 (+ 1349us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.975960 (+ 926us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.979630 (+ 3670us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:37.979642 (+ 12us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:37.979656 (+ 14us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:37.979720 (+ 64us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:37.983946 (+ 4226us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.984919 (+ 973us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.984926 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.984933 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.985124 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.985585 (+ 461us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.985592 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.985597 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.986177 (+ 580us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:37.986391 (+ 214us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:37.987007 (+ 616us) server_negotiation.cc:299] Negotiation successful
0807 19:54:37.987448 (+ 441us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":821,"thread_start_us":521,"threads_started":1}
I20260807 19:54:37.995548 18320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.970564 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58274 (local address 127.12.155.190:46849)
0807 19:54:37.977475 (+ 6911us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.977482 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.977505 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:54:37.977576 (+ 71us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.977584 (+ 8us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.977672 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.977875 (+ 203us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:37.979528 (+ 1653us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.980206 (+ 678us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.982564 (+ 2358us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.982984 (+ 420us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.983129 (+ 145us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.987466 (+ 4337us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:37.987475 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:37.987482 (+ 7us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:37.987519 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:37.991691 (+ 4172us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.992834 (+ 1143us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.992840 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.992844 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.993023 (+ 179us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.993508 (+ 485us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.993516 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.993524 (+ 8us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.993967 (+ 443us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:37.994152 (+ 185us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:37.994807 (+ 655us) server_negotiation.cc:299] Negotiation successful
0807 19:54:37.995062 (+ 255us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":6720,"thread_start_us":6510,"threads_started":1}
I20260807 19:54:37.995559 18319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.970120 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.190:46849 (local address 127.0.0.1:58274)
0807 19:54:37.975127 (+ 5007us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:37.975181 (+ 54us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:37.975341 (+ 160us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:37.977970 (+ 2629us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:37.977977 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:37.978846 (+ 869us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:37.979340 (+ 494us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.979353 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.980697 (+ 1344us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.980704 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.982392 (+ 1688us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:37.982405 (+ 13us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.983193 (+ 788us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.983201 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:37.983387 (+ 186us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.984109 (+ 722us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:37.984132 (+ 23us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:37.987192 (+ 3060us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:37.991924 (+ 4732us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.991941 (+ 17us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.991959 (+ 18us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.992671 (+ 712us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.993166 (+ 495us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:37.993172 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:37.993176 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:37.993370 (+ 194us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:37.994165 (+ 795us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:37.994174 (+ 9us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:37.994392 (+ 218us) client_negotiation.cc:769] Sending connection context
0807 19:54:37.994671 (+ 279us) client_negotiation.cc:240] Negotiation successful
0807 19:54:37.995053 (+ 382us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":4727,"mutex_wait_us":31,"thread_start_us":4525,"threads_started":1}
I20260807 19:54:37.996825 18050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: Bootstrap starting.
I20260807 19:54:37.997386 18318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.964502 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50552 (local address 127.12.155.188:43815)
0807 19:54:37.976328 (+ 11826us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.976332 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.976351 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:54:37.976388 (+ 37us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.976392 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.976445 (+ 53us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.976582 (+ 137us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:37.978842 (+ 2260us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.980248 (+ 1406us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.982162 (+ 1914us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:37.982992 (+ 830us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:37.983138 (+ 146us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:37.989250 (+ 6112us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:37.989258 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:37.989264 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:37.989300 (+ 36us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:37.993594 (+ 4294us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.994548 (+ 954us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.994553 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.994557 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.994704 (+ 147us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:37.995178 (+ 474us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:37.995187 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:37.995193 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:37.995556 (+ 363us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:37.996317 (+ 761us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:37.996670 (+ 353us) server_negotiation.cc:299] Negotiation successful
0807 19:54:37.996887 (+ 217us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":11684,"spinlock_wait_cycles":18304,"thread_start_us":11657,"threads_started":1}
I20260807 19:54:38.000689 18050 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:38.002353 18050 log.cc:824] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:38.003525 18311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:38.005824 18050 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: No bootstrap required, opened a new log
Aug 07 19:54:38 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.190@KRBTEST.COM
Aug 07 19:54:38 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:38.017104 18050 raft_consensus.cc:348] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.017514 18050 raft_consensus.cc:729] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 182ef70d9334453b9fae2ae8df0f6c36, State: Initialized, Role: FOLLOWER
I20260807 19:54:38.018121 18050 consensus_queue.cc:260] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.019097 18320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:37.999370 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58282 (local address 127.12.155.190:46849)
0807 19:54:37.999565 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:37.999571 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:37.999591 (+ 20us) server_negotiation.cc:407] Connection header received
0807 19:54:37.999758 (+ 167us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:37.999767 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:37.999869 (+ 102us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:37.999987 (+ 118us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.001470 (+ 1483us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.002624 (+ 1154us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.004690 (+ 2066us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.005426 (+ 736us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.005598 (+ 172us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.011187 (+ 5589us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.011194 (+ 7us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.011199 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.011245 (+ 46us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.015246 (+ 4001us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.016181 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.016187 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.016191 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.016327 (+ 136us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.017262 (+ 935us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.017272 (+ 10us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.017276 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.017744 (+ 468us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.018135 (+ 391us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.018461 (+ 326us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.018707 (+ 246us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":70}
I20260807 19:54:38.020061 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.004381 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48228 (local address 127.12.155.189:40457)
0807 19:54:38.004582 (+ 201us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.004590 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.004670 (+ 80us) server_negotiation.cc:407] Connection header received
0807 19:54:38.004849 (+ 179us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.004855 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.004943 (+ 88us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.005063 (+ 120us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.006105 (+ 1042us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.006866 (+ 761us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.008182 (+ 1316us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.008674 (+ 492us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.008828 (+ 154us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.012752 (+ 3924us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.012761 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.012771 (+ 10us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.012808 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.016323 (+ 3515us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.017342 (+ 1019us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.017348 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.017352 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.017543 (+ 191us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.018130 (+ 587us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.018136 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.018139 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.018740 (+ 601us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.018875 (+ 135us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.019548 (+ 673us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.019778 (+ 230us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":88}
I20260807 19:54:38.021025 18319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.004287 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.189:40457 (local address 127.0.0.1:48228)
0807 19:54:38.004577 (+ 290us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:38.004599 (+ 22us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:38.004713 (+ 114us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:38.005109 (+ 396us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:38.005114 (+ 5us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:38.005643 (+ 529us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:38.005844 (+ 201us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:38.005853 (+ 9us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.007050 (+ 1197us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.007057 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:38.008011 (+ 954us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:38.008023 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.008845 (+ 822us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.008852 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:38.009106 (+ 254us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.009775 (+ 669us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:38.009803 (+ 28us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:38.012539 (+ 2736us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:38.016590 (+ 4051us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:38.016594 (+ 4us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:38.016597 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:38.017195 (+ 598us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:38.017717 (+ 522us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:38.017722 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:38.017726 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:38.017918 (+ 192us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:38.018988 (+ 1070us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:38.018993 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:38.019176 (+ 183us) client_negotiation.cc:769] Sending connection context
0807 19:54:38.020346 (+ 1170us) client_negotiation.cc:240] Negotiation successful
0807 19:54:38.020684 (+ 338us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":147}
I20260807 19:54:38.022253 18311 sys_catalog.cc:422] member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } has no permanent_uuid. Determining permanent_uuid...
I20260807 19:54:38.023844 18050 sys_catalog.cc:564] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:38.022524 18322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.024371 18322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: This master's current role is: FOLLOWER
Aug 07 19:54:38 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.188@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
Aug 07 19:54:38 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132476, etypes {rep=17 tkt=17 ses=17}, test-admin@KRBTEST.COM for kudu/127.12.155.189@KRBTEST.COM
I20260807 19:54:38.041352 18319 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.023091 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50554)
0807 19:54:38.023281 (+ 190us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:38.023301 (+ 20us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:38.023400 (+ 99us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:38.023901 (+ 501us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:38.023908 (+ 7us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:38.024368 (+ 460us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:38.024598 (+ 230us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:38.024610 (+ 12us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.026018 (+ 1408us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.026023 (+ 5us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:38.027538 (+ 1515us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:38.027554 (+ 16us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.028712 (+ 1158us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.028718 (+ 6us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:38.028947 (+ 229us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.029883 (+ 936us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:38.029929 (+ 46us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:38.033166 (+ 3237us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:38.038405 (+ 5239us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:38.038412 (+ 7us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:38.038417 (+ 5us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:38.038990 (+ 573us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:38.039439 (+ 449us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:38.039444 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:38.039447 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:38.039629 (+ 182us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:38.040320 (+ 691us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:38.040325 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:38.040507 (+ 182us) client_negotiation.cc:769] Sending connection context
0807 19:54:38.040654 (+ 147us) client_negotiation.cc:240] Negotiation successful
0807 19:54:38.040953 (+ 299us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":67}
I20260807 19:54:38.042312 18318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.023360 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50554 (local address 127.12.155.188:43815)
0807 19:54:38.023581 (+ 221us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.023587 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.023606 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:54:38.023655 (+ 49us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.023660 (+ 5us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.023734 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.023853 (+ 119us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.024765 (+ 912us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.025866 (+ 1101us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.027703 (+ 1837us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.028389 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.028521 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.033381 (+ 4860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.033387 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.033392 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.033429 (+ 37us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.038257 (+ 4828us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.039129 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.039136 (+ 7us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.039143 (+ 7us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.039310 (+ 167us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.039756 (+ 446us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.039760 (+ 4us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.039763 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.040118 (+ 355us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.040271 (+ 153us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.041747 (+ 1476us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.041973 (+ 226us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":68}
I20260807 19:54:38.042922 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.021191 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48234 (local address 127.12.155.189:40457)
0807 19:54:38.021665 (+ 474us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.021672 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.021691 (+ 19us) server_negotiation.cc:407] Connection header received
0807 19:54:38.021741 (+ 50us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.021745 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.021824 (+ 79us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.021932 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.024133 (+ 2201us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.025544 (+ 1411us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.027566 (+ 2022us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.028299 (+ 733us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.028406 (+ 107us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.035138 (+ 6732us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.035146 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.035152 (+ 6us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.035195 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.039070 (+ 3875us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.039906 (+ 836us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.039911 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.039915 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.040118 (+ 203us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.040641 (+ 523us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.040646 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.040649 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.040992 (+ 343us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.041243 (+ 251us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.042134 (+ 891us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.042606 (+ 472us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":348}
I20260807 19:54:38.048091 18311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: Bootstrap starting.
I20260807 19:54:38.049865 12910 external_mini_cluster.cc:930] 0 TS(s) registered with all masters
I20260807 19:54:38.034336 17930 master_runner.cc:186] Error getting master registration for 127.12.155.189:40457: OK, instance_id { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" instance_seqno: 1786132477391741 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:54:38.050807 17930 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:54:38.052139 18311 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: Neither blocks nor log segments found. Creating new log.
W20260807 19:54:38.052680 17967 tablet.cc:2369] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:54:38.053131 18003 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "00000000000000000000000000000000"
dest_uuid: "182ef70d9334453b9fae2ae8df0f6c36"
from {username='test-admin', principal='test-admin@KRBTEST.COM'} at 127.0.0.1:58282
I20260807 19:54:38.053503 18003 raft_consensus.cc:482] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 0 FOLLOWER]: Starting forced leader election (received explicit request)
W20260807 19:54:38.053602 18344 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
I20260807 19:54:38.053718 18003 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 0 FOLLOWER]: Advancing to term 1
W20260807 19:54:38.053726 18344 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:54:38.054486 18311 log.cc:824] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:38.057212 18311 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: No bootstrap required, opened a new log
I20260807 19:54:38.057312 18003 raft_consensus.cc:504] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 1 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.059489 18003 leader_election.cc:288] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [CANDIDATE]: Term 1 election: Requested vote from peers 082138f5cc744b49bfcc1c5c83f7ceef (127.12.155.189:40457), 6f10f1d42d0c43acabf841dfe46ea854 (127.12.155.188:43815)
I20260807 19:54:38.068928 18311 raft_consensus.cc:348] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.069392 18311 raft_consensus.cc:729] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 6f10f1d42d0c43acabf841dfe46ea854, State: Initialized, Role: FOLLOWER
I20260807 19:54:38.069928 18311 consensus_queue.cc:260] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.076939 18352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.077342 18352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:38.079224 18311 sys_catalog.cc:564] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:38.079286 18269 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "182ef70d9334453b9fae2ae8df0f6c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "6f10f1d42d0c43acabf841dfe46ea854"
I20260807 19:54:38.079782 18269 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:38.084249 18269 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 182ef70d9334453b9fae2ae8df0f6c36 in term 1.
I20260807 19:54:38.085255 17955 leader_election.cc:302] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 182ef70d9334453b9fae2ae8df0f6c36, 6f10f1d42d0c43acabf841dfe46ea854; no voters:
I20260807 19:54:38.085844 18322 raft_consensus.cc:2781] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 1 FOLLOWER]: Leader election won for term 1
I20260807 19:54:38.101547 18322 raft_consensus.cc:686] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [term 1 LEADER]: Becoming Leader. State: Replica: 182ef70d9334453b9fae2ae8df0f6c36, State: Running, Role: LEADER
I20260807 19:54:38.102427 18322 consensus_queue.cc:237] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.117223 18357 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 182ef70d9334453b9fae2ae8df0f6c36. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.117836 18357 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:38.121336 18180 consensus_peers.cc:656] Retrying to get permanent uuid for remote peer: member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } attempt: 5
I20260807 19:54:38.126799 18318 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.096719 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50566 (local address 127.12.155.188:43815)
0807 19:54:38.096896 (+ 177us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.096902 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.108396 (+ 11494us) server_negotiation.cc:407] Connection header received
0807 19:54:38.108937 (+ 541us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.108944 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.109049 (+ 105us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.109129 (+ 80us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.111273 (+ 2144us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.112384 (+ 1111us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.114736 (+ 2352us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.115428 (+ 692us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.115533 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.118894 (+ 3361us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.118903 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.118908 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.118953 (+ 45us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.123215 (+ 4262us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.124087 (+ 872us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.124093 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.124096 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.124255 (+ 159us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.124743 (+ 488us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.124748 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.124753 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.125225 (+ 472us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.125551 (+ 326us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.126193 (+ 642us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.126424 (+ 231us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":4,"server-negotiator.queue_time_us":65}
I20260807 19:54:38.127827 18370 catalog_manager.cc:1475] Loading table and tablet metadata into memory...
I20260807 19:54:38.130823 18370 catalog_manager.cc:1484] Initializing Kudu cluster ID...
I20260807 19:54:38.131407 18320 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.094958 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58286 (local address 127.12.155.190:46849)
0807 19:54:38.095203 (+ 245us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.095213 (+ 10us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.096492 (+ 1279us) server_negotiation.cc:407] Connection header received
0807 19:54:38.097074 (+ 582us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.097083 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.097186 (+ 103us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.097272 (+ 86us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.101930 (+ 4658us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.103123 (+ 1193us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.106610 (+ 3487us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.107351 (+ 741us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.107483 (+ 132us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.114343 (+ 6860us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.114351 (+ 8us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.114355 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.114420 (+ 65us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.118656 (+ 4236us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.120097 (+ 1441us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.120106 (+ 9us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.120112 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.120296 (+ 184us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.120874 (+ 578us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.120880 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.120884 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.121288 (+ 404us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.121575 (+ 287us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.130735 (+ 9160us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.130998 (+ 263us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":74}
Aug 07 19:54:38 dist-test-slave-2p8l krb5kdc[17907](info): TGS_REQ (2 etypes {17 16}) 127.0.0.1: ISSUE: authtime 1786132477, etypes {rep=17 tkt=17 ses=17}, kudu/127.12.155.189@KRBTEST.COM for kudu/127.12.155.188@KRBTEST.COM
I20260807 19:54:38.139125 18192 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.104891 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48240 (local address 127.12.155.189:40457)
0807 19:54:38.105097 (+ 206us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.105103 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.112107 (+ 7004us) server_negotiation.cc:407] Connection header received
0807 19:54:38.112333 (+ 226us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.112339 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.112424 (+ 85us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.112512 (+ 88us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.119157 (+ 6645us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.120325 (+ 1168us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.122337 (+ 2012us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.123041 (+ 704us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.123146 (+ 105us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.130752 (+ 7606us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.130758 (+ 6us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.130763 (+ 5us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.130792 (+ 29us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.134528 (+ 3736us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.135299 (+ 771us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.135305 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.135308 (+ 3us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.135514 (+ 206us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.135952 (+ 438us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.135958 (+ 6us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.135964 (+ 6us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.136882 (+ 918us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.137218 (+ 336us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.138485 (+ 1267us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.138756 (+ 271us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":50}
I20260807 19:54:38.144469 18186 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.121977 (+ 0us) reactor.cc:625] Submitting negotiation task for client connection to 127.12.155.188:43815 (local address 127.0.0.1:50582)
0807 19:54:38.122426 (+ 449us) negotiation.cc:107] Waiting for socket to connect
0807 19:54:38.122450 (+ 24us) client_negotiation.cc:174] Beginning negotiation
0807 19:54:38.122567 (+ 117us) client_negotiation.cc:252] Sending NEGOTIATE NegotiatePB request
0807 19:54:38.123701 (+ 1134us) client_negotiation.cc:271] Received NEGOTIATE NegotiatePB response
0807 19:54:38.123710 (+ 9us) client_negotiation.cc:394] Received NEGOTIATE response from server
0807 19:54:38.124300 (+ 590us) client_negotiation.cc:189] Negotiated authn=SASL
0807 19:54:38.124567 (+ 267us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:38.124582 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.126413 (+ 1831us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.126421 (+ 8us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:38.128825 (+ 2404us) client_negotiation.cc:514] Sending TLS_HANDSHAKE message to server
0807 19:54:38.128840 (+ 15us) client_negotiation.cc:252] Sending TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.129822 (+ 982us) client_negotiation.cc:271] Received TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.129829 (+ 7us) client_negotiation.cc:527] Received TLS_HANDSHAKE response from server
0807 19:54:38.130109 (+ 280us) client_negotiation.cc:548] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.130743 (+ 634us) client_negotiation.cc:623] Initiating SASL GSSAPI handshake
0807 19:54:38.130764 (+ 21us) client_negotiation.cc:656] calling sasl_client_start()
0807 19:54:38.135475 (+ 4711us) client_negotiation.cc:252] Sending SASL_INITIATE NegotiatePB request
0807 19:54:38.141248 (+ 5773us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:38.141254 (+ 6us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:38.141258 (+ 4us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:38.141994 (+ 736us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:38.142475 (+ 481us) client_negotiation.cc:271] Received SASL_CHALLENGE NegotiatePB response
0807 19:54:38.142480 (+ 5us) client_negotiation.cc:694] Received SASL_CHALLENGE response from server
0807 19:54:38.142483 (+ 3us) client_negotiation.cc:760] calling sasl_client_step()
0807 19:54:38.142692 (+ 209us) client_negotiation.cc:252] Sending SASL_RESPONSE NegotiatePB request
0807 19:54:38.143424 (+ 732us) client_negotiation.cc:271] Received SASL_SUCCESS NegotiatePB response
0807 19:54:38.143429 (+ 5us) client_negotiation.cc:715] Received SASL_SUCCESS response from server
0807 19:54:38.143582 (+ 153us) client_negotiation.cc:769] Sending connection context
0807 19:54:38.143750 (+ 168us) client_negotiation.cc:240] Negotiation successful
0807 19:54:38.144051 (+ 301us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"client-negotiator.queue_time_us":293}
I20260807 19:54:38.145462 18313 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:38.122952 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50582 (local address 127.12.155.188:43815)
0807 19:54:38.123177 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.123184 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.123210 (+ 26us) server_negotiation.cc:407] Connection header received
0807 19:54:38.123271 (+ 61us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.123293 (+ 22us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.123382 (+ 89us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.123496 (+ 114us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.124804 (+ 1308us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.126197 (+ 1393us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.129041 (+ 2844us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:38.129645 (+ 604us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:38.129788 (+ 143us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:38.135688 (+ 5900us) server_negotiation.cc:365] Received SASL_INITIATE NegotiatePB request
0807 19:54:38.135697 (+ 9us) server_negotiation.cc:881] Received SASL_INITIATE request from client
0807 19:54:38.135701 (+ 4us) server_negotiation.cc:892] Client requested to use mechanism: GSSAPI
0807 19:54:38.135744 (+ 43us) server_negotiation.cc:922] calling sasl_server_start()
0807 19:54:38.141021 (+ 5277us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.142171 (+ 1150us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.142179 (+ 8us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.142184 (+ 5us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.142337 (+ 153us) server_negotiation.cc:377] Sending SASL_CHALLENGE NegotiatePB response
0807 19:54:38.142830 (+ 493us) server_negotiation.cc:365] Received SASL_RESPONSE NegotiatePB request
0807 19:54:38.142835 (+ 5us) server_negotiation.cc:956] Received SASL_RESPONSE request from client
0807 19:54:38.142839 (+ 4us) server_negotiation.cc:967] calling sasl_server_step()
0807 19:54:38.143209 (+ 370us) server_negotiation.cc:377] Sending SASL_SUCCESS NegotiatePB response
0807 19:54:38.143357 (+ 148us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:38.144795 (+ 1438us) server_negotiation.cc:299] Negotiation successful
0807 19:54:38.145078 (+ 283us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"mutex_wait_us":27,"server-negotiator.queue_time_us":85}
I20260807 19:54:38.149574 18269 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [term 1 FOLLOWER]: Refusing update from remote peer 182ef70d9334453b9fae2ae8df0f6c36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:54:38.151333 18357 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20260807 19:54:38.155654 18180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: Bootstrap starting.
I20260807 19:54:38.165146 18180 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: Neither blocks nor log segments found. Creating new log.
I20260807 19:54:38.167328 18180 log.cc:824] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: Log is configured to *not* fsync() on all Append() calls
I20260807 19:54:38.181221 18180 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: No bootstrap required, opened a new log
W20260807 19:54:38.183652 18235 tablet.cc:2369] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20260807 19:54:38.193873 18180 raft_consensus.cc:348] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.194443 18180 raft_consensus.cc:729] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 082138f5cc744b49bfcc1c5c83f7ceef, State: Initialized, Role: FOLLOWER
I20260807 19:54:38.196206 18180 consensus_queue.cc:260] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } }
I20260807 19:54:38.196836 18352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 182ef70d9334453b9fae2ae8df0f6c36. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.197142 18352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:38.198558 18375 mvcc.cc:205] Tried to move back new op lower bound from 7315998630472798208 to 7315998630314659840. Current Snapshot: MvccSnapshot[applied={T|T < 7315998630472798208}]
I20260807 19:54:38.209455 18322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.209915 18322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:38.217671 18389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 0 committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.218161 18389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:38.218955 18370 catalog_manager.cc:1347] Generated new cluster ID: de869cf49ed54bcea061fea314c00023
I20260807 19:54:38.219065 18370 catalog_manager.cc:1495] Initializing Kudu internal certificate authority...
I20260807 19:54:38.216566 18352 sys_catalog.cc:455] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.219225 18352 sys_catalog.cc:458] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854 [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:38.219256 18180 sys_catalog.cc:564] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: configured and running, proceeding with master startup.
I20260807 19:54:38.221045 18129 raft_consensus.cc:3037] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [term 0 FOLLOWER]: Advancing to term 1
I20260807 19:54:38.223773 18132 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "00000000000000000000000000000000" candidate_uuid: "182ef70d9334453b9fae2ae8df0f6c36" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: true dest_uuid: "082138f5cc744b49bfcc1c5c83f7ceef"
I20260807 19:54:38.228175 18129 raft_consensus.cc:1261] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [term 1 FOLLOWER]: Refusing update from remote peer 182ef70d9334453b9fae2ae8df0f6c36: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20260807 19:54:38.231714 18132 raft_consensus.cc:2454] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 182ef70d9334453b9fae2ae8df0f6c36 in term 1.
I20260807 19:54:38.234165 18357 consensus_queue.cc:1035] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [LEADER]: Connected to new peer: Peer: permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20260807 19:54:38.237133 18393 catalog_manager.cc:1558] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: loading cluster ID for follower catalog manager: Not found: cluster ID entry not found
W20260807 19:54:38.237268 18393 catalog_manager.cc:873] Not found: cluster ID entry not found: failed to prepare follower catalog manager, will retry
I20260807 19:54:38.229595 18195 master_runner.cc:186] Error getting master registration for 127.12.155.189:40457: OK, instance_id { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" instance_seqno: 1786132477391741 } error { code: CATALOG_MANAGER_NOT_INITIALIZED status { code: SERVICE_UNAVAILABLE message: "Catalog manager is not initialized. State: Starting" } }
I20260807 19:54:38.242767 18195 master_runner.cc:418] Couldn't verify the masters in the cluster. Trying again...
I20260807 19:54:38.258162 18370 catalog_manager.cc:1370] Generated new certificate authority record
I20260807 19:54:38.261014 18370 catalog_manager.cc:1504] Loading token signing keys...
I20260807 19:54:38.285178 18389 sys_catalog.cc:455] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: SysCatalogTable state changed. Reason: New leader 182ef70d9334453b9fae2ae8df0f6c36. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.285540 18389 sys_catalog.cc:458] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:38.286183 18408 sys_catalog.cc:455] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: SysCatalogTable state changed. Reason: Replicated consensus-only round. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.286763 18408 sys_catalog.cc:458] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef [sys.catalog]: This master's current role is: FOLLOWER
I20260807 19:54:38.288311 18322 sys_catalog.cc:455] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: SysCatalogTable state changed. Reason: Peer health change. Latest consensus state: current_term: 1 leader_uuid: "182ef70d9334453b9fae2ae8df0f6c36" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "182ef70d9334453b9fae2ae8df0f6c36" member_type: VOTER last_known_addr { host: "127.12.155.190" port: 46849 } } peers { permanent_uuid: "082138f5cc744b49bfcc1c5c83f7ceef" member_type: VOTER last_known_addr { host: "127.12.155.189" port: 40457 } } peers { permanent_uuid: "6f10f1d42d0c43acabf841dfe46ea854" member_type: VOTER last_known_addr { host: "127.12.155.188" port: 43815 } } }
I20260807 19:54:38.288620 18322 sys_catalog.cc:458] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36 [sys.catalog]: This master's current role is: LEADER
I20260807 19:54:38.297521 18370 catalog_manager.cc:5868] T 00000000000000000000000000000000 P 182ef70d9334453b9fae2ae8df0f6c36: Generated new TSK 0
I20260807 19:54:38.298697 18370 catalog_manager.cc:1514] Initializing in-progress tserver states...
I20260807 19:54:38.382247 18436 catalog_manager.cc:795] Waiting for catalog manager background task thread to start: Service unavailable: Catalog manager is not initialized. State: Starting
W20260807 19:54:38.446955 18313 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.431794 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50584 (local address 127.12.155.188:43815)
0807 19:54:38.432058 (+ 264us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.432067 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.444659 (+ 12592us) server_negotiation.cc:407] Connection header received
0807 19:54:38.445201 (+ 542us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.445208 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.445302 (+ 94us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.445380 (+ 78us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.446690 (+ 1310us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:50584: BlockingRecv error: recv got EOF from 127.0.0.1:50584 (error 108)
Metrics: {"server-negotiator.queue_time_us":53}
W20260807 19:54:38.450039 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.437933 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48250 (local address 127.12.155.189:40457)
0807 19:54:38.438149 (+ 216us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.438157 (+ 8us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.448464 (+ 10307us) server_negotiation.cc:407] Connection header received
0807 19:54:38.448708 (+ 244us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.448714 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.448790 (+ 76us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.448855 (+ 65us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.449820 (+ 965us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48250: BlockingRecv error: recv got EOF from 127.0.0.1:48250 (error 108)
Metrics: {"server-negotiator.queue_time_us":61}
W20260807 19:54:38.452060 18320 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.431608 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58300 (local address 127.12.155.190:46849)
0807 19:54:38.432032 (+ 424us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.432038 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.447978 (+ 15940us) server_negotiation.cc:407] Connection header received
0807 19:54:38.450685 (+ 2707us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.450691 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.450774 (+ 83us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.450880 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.451825 (+ 945us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:58300: BlockingRecv error: recv got EOF from 127.0.0.1:58300 (error 108)
Metrics: {"server-negotiator.queue_time_us":258}
W20260807 19:54:38.458181 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.455986 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48260 (local address 127.12.155.189:40457)
0807 19:54:38.456182 (+ 196us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.456187 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.456735 (+ 548us) server_negotiation.cc:407] Connection header received
0807 19:54:38.456953 (+ 218us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.456959 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.457070 (+ 111us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.457193 (+ 123us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.457913 (+ 720us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48260: BlockingRecv error: recv got EOF from 127.0.0.1:48260 (error 108)
Metrics: {"server-negotiator.queue_time_us":70}
W20260807 19:54:38.464257 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.462187 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48262 (local address 127.12.155.189:40457)
0807 19:54:38.462345 (+ 158us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.462351 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.462894 (+ 543us) server_negotiation.cc:407] Connection header received
0807 19:54:38.463062 (+ 168us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.463068 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.463152 (+ 84us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.463258 (+ 106us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.464056 (+ 798us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48262: BlockingRecv error: recv got EOF from 127.0.0.1:48262 (error 108)
Metrics: {"server-negotiator.queue_time_us":57}
W20260807 19:54:38.477947 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.475764 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48264 (local address 127.12.155.189:40457)
0807 19:54:38.475918 (+ 154us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.475923 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.476393 (+ 470us) server_negotiation.cc:407] Connection header received
0807 19:54:38.476659 (+ 266us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.476665 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.476764 (+ 99us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.476872 (+ 108us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.477713 (+ 841us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48264: BlockingRecv error: recv got EOF from 127.0.0.1:48264 (error 108)
Metrics: {"server-negotiator.queue_time_us":52}
W20260807 19:54:38.490118 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.488027 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48268 (local address 127.12.155.189:40457)
0807 19:54:38.488229 (+ 202us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.488235 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.488732 (+ 497us) server_negotiation.cc:407] Connection header received
0807 19:54:38.488910 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.488917 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.489004 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.489108 (+ 104us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.489864 (+ 756us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48268: BlockingRecv error: recv got EOF from 127.0.0.1:48268 (error 108)
Metrics: {"server-negotiator.queue_time_us":99}
W20260807 19:54:38.504316 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.502031 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48284 (local address 127.12.155.189:40457)
0807 19:54:38.502226 (+ 195us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.502232 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.502829 (+ 597us) server_negotiation.cc:407] Connection header received
0807 19:54:38.503010 (+ 181us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.503016 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.503112 (+ 96us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.503224 (+ 112us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.504071 (+ 847us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48284: BlockingRecv error: recv got EOF from 127.0.0.1:48284 (error 108)
Metrics: {"server-negotiator.queue_time_us":80}
W20260807 19:54:38.526873 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.524340 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48298 (local address 127.12.155.189:40457)
0807 19:54:38.524573 (+ 233us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.524580 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.525155 (+ 575us) server_negotiation.cc:407] Connection header received
0807 19:54:38.525435 (+ 280us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.525442 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.525543 (+ 101us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.525668 (+ 125us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.526609 (+ 941us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48298: BlockingRecv error: recv got EOF from 127.0.0.1:48298 (error 108)
Metrics: {"server-negotiator.queue_time_us":73}
W20260807 19:54:38.567031 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.564461 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48302 (local address 127.12.155.189:40457)
0807 19:54:38.564686 (+ 225us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.564693 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.565309 (+ 616us) server_negotiation.cc:407] Connection header received
0807 19:54:38.565533 (+ 224us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.565539 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.565658 (+ 119us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.565771 (+ 113us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.566752 (+ 981us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48302: BlockingRecv error: recv got EOF from 127.0.0.1:48302 (error 108)
Metrics: {"server-negotiator.queue_time_us":79}
W20260807 19:54:38.644191 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.641736 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48318 (local address 127.12.155.189:40457)
0807 19:54:38.641943 (+ 207us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.641950 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.642554 (+ 604us) server_negotiation.cc:407] Connection header received
0807 19:54:38.642783 (+ 229us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.642792 (+ 9us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.642898 (+ 106us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.643019 (+ 121us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.643946 (+ 927us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48318: BlockingRecv error: recv got EOF from 127.0.0.1:48318 (error 108)
Metrics: {"server-negotiator.queue_time_us":71}
W20260807 19:54:38.777601 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:38.775663 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48328 (local address 127.12.155.189:40457)
0807 19:54:38.775867 (+ 204us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:38.775872 (+ 5us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:38.776217 (+ 345us) server_negotiation.cc:407] Connection header received
0807 19:54:38.776386 (+ 169us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:38.776390 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:38.776468 (+ 78us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:38.776619 (+ 151us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:38.777393 (+ 774us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48328: BlockingRecv error: recv got EOF from 127.0.0.1:48328 (error 108)
Metrics: {"server-negotiator.queue_time_us":78}
W20260807 19:54:39.041939 18192 negotiation.cc:337] Failed RPC negotiation. Trace:
0807 19:54:39.040040 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48334 (local address 127.12.155.189:40457)
0807 19:54:39.040319 (+ 279us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:39.040326 (+ 7us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:39.040572 (+ 246us) server_negotiation.cc:407] Connection header received
0807 19:54:39.040791 (+ 219us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:39.040795 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:39.040869 (+ 74us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:39.040959 (+ 90us) server_negotiation.cc:226] Negotiated authn=SASL
0807 19:54:39.041690 (+ 731us) negotiation.cc:327] Negotiation complete: Network error: Server connection negotiation failed: server connection from 127.0.0.1:48334: BlockingRecv error: recv got EOF from 127.0.0.1:48334 (error 108)
Metrics: {"server-negotiator.queue_time_us":94}
I20260807 19:54:39.239262 18393 catalog_manager.cc:1259] Loaded cluster ID: de869cf49ed54bcea061fea314c00023
I20260807 19:54:39.239394 18393 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: loading cluster ID for follower catalog manager: success
I20260807 19:54:39.241977 18393 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: acquiring CA information for follower catalog manager: success
I20260807 19:54:39.243815 18393 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 6f10f1d42d0c43acabf841dfe46ea854: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:54:39.387506 18436 catalog_manager.cc:1259] Loaded cluster ID: de869cf49ed54bcea061fea314c00023
I20260807 19:54:39.387683 18436 catalog_manager.cc:1552] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: loading cluster ID for follower catalog manager: success
I20260807 19:54:39.390393 18436 catalog_manager.cc:1574] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: acquiring CA information for follower catalog manager: success
I20260807 19:54:39.392222 18436 catalog_manager.cc:1602] T 00000000000000000000000000000000 P 082138f5cc744b49bfcc1c5c83f7ceef: importing token verification keys for follower catalog manager: success; most recent TSK sequence number 0
I20260807 19:54:39.570278 18546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:39.562965 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48342 (local address 127.12.155.189:40457)
0807 19:54:39.563680 (+ 715us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:39.563686 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:39.563966 (+ 280us) server_negotiation.cc:407] Connection header received
0807 19:54:39.564139 (+ 173us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:39.564143 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:39.564302 (+ 159us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:39.564413 (+ 111us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:39.564949 (+ 536us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.565776 (+ 827us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.567802 (+ 2026us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.568262 (+ 460us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.568358 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:39.568950 (+ 592us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:39.569505 (+ 555us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:39.569620 (+ 115us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:39.569772 (+ 152us) server_negotiation.cc:299] Negotiation successful
0807 19:54:39.569849 (+ 77us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":561,"thread_start_us":369,"threads_started":1}
I20260807 19:54:39.584021 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:39.577818 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50586 (local address 127.12.155.188:43815)
0807 19:54:39.578744 (+ 926us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:39.578748 (+ 4us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:39.578771 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:54:39.578857 (+ 86us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:39.578861 (+ 4us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:39.578995 (+ 134us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:39.579207 (+ 212us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:39.579640 (+ 433us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.580469 (+ 829us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.581756 (+ 1287us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.582215 (+ 459us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.582352 (+ 137us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:39.582883 (+ 531us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:39.583382 (+ 499us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:39.583562 (+ 180us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:39.583651 (+ 89us) server_negotiation.cc:299] Negotiation successful
0807 19:54:39.583733 (+ 82us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":828,"thread_start_us":716,"threads_started":1}
I20260807 19:54:39.608057 18565 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:39.591192 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:58310 (local address 127.12.155.190:46849)
0807 19:54:39.598822 (+ 7630us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:39.598828 (+ 6us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:39.598851 (+ 23us) server_negotiation.cc:407] Connection header received
0807 19:54:39.598976 (+ 125us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:39.598982 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:39.599219 (+ 237us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:39.600063 (+ 844us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:39.600270 (+ 207us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.602370 (+ 2100us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.604705 (+ 2335us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.605391 (+ 686us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.606301 (+ 910us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:39.606517 (+ 216us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:39.607012 (+ 495us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:39.607574 (+ 562us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:39.607630 (+ 56us) server_negotiation.cc:299] Negotiation successful
0807 19:54:39.607720 (+ 90us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":7491,"thread_start_us":7350,"threads_started":1}
I20260807 19:54:39.610654 18555 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:39.591088 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:50598 (local address 127.12.155.188:43815)
0807 19:54:39.591587 (+ 499us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:39.591596 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:39.601960 (+ 10364us) server_negotiation.cc:407] Connection header received
0807 19:54:39.602138 (+ 178us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:39.602145 (+ 7us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:39.602261 (+ 116us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:39.602389 (+ 128us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:39.603461 (+ 1072us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.604924 (+ 1463us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.608190 (+ 3266us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.608901 (+ 711us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.609002 (+ 101us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:39.609681 (+ 679us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:39.609824 (+ 143us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:39.609892 (+ 68us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:39.610234 (+ 342us) server_negotiation.cc:299] Negotiation successful
0807 19:54:39.610328 (+ 94us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":334}
I20260807 19:54:39.613379 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 17930
I20260807 19:54:39.614439 18042 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:39.615069 18546 negotiation.cc:339] RPC negotiation tracing enabled. Trace:
0807 19:54:39.590643 (+ 0us) reactor.cc:625] Submitting negotiation task for server connection from 127.0.0.1:48356 (local address 127.12.155.189:40457)
0807 19:54:39.590963 (+ 320us) server_negotiation.cc:206] Beginning negotiation
0807 19:54:39.590972 (+ 9us) server_negotiation.cc:399] Waiting for connection header
0807 19:54:39.606961 (+ 15989us) server_negotiation.cc:407] Connection header received
0807 19:54:39.607262 (+ 301us) server_negotiation.cc:365] Received NEGOTIATE NegotiatePB request
0807 19:54:39.607268 (+ 6us) server_negotiation.cc:461] Received NEGOTIATE request from client
0807 19:54:39.607355 (+ 87us) server_negotiation.cc:377] Sending NEGOTIATE NegotiatePB response
0807 19:54:39.607418 (+ 63us) server_negotiation.cc:226] Negotiated authn=TOKEN
0807 19:54:39.608703 (+ 1285us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.609864 (+ 1161us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.612498 (+ 2634us) server_negotiation.cc:365] Received TLS_HANDSHAKE NegotiatePB request
0807 19:54:39.613220 (+ 722us) server_negotiation.cc:377] Sending TLS_HANDSHAKE NegotiatePB response
0807 19:54:39.613316 (+ 96us) server_negotiation.cc:657] Negotiated auth-only TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 TLSv1.2 Kx=ECDH Au=RSA Enc=AESGCM(128) Mac=AEAD
0807 19:54:39.614103 (+ 787us) server_negotiation.cc:365] Received TOKEN_EXCHANGE NegotiatePB request
0807 19:54:39.614267 (+ 164us) server_negotiation.cc:377] Sending TOKEN_EXCHANGE NegotiatePB response
0807 19:54:39.614389 (+ 122us) server_negotiation.cc:1035] Waiting for connection context
0807 19:54:39.614524 (+ 135us) server_negotiation.cc:299] Negotiation successful
0807 19:54:39.614632 (+ 108us) negotiation.cc:327] Negotiation complete: OK
Metrics: {"server-negotiator.queue_time_us":171}
I20260807 19:54:39.747896 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 17930
I20260807 19:54:39.781456 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18064
I20260807 19:54:39.782701 18166 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:39.889956 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18064
I20260807 19:54:39.917402 12910 external_mini_cluster.cc:1636] Attempting to check leaks for /tmp/dist-test-taskviQnk1/build/asan/bin/kudu pid 18195
I20260807 19:54:39.918634 18304 generic_service.cc:196] Checking for leaks (request via RPC)
I20260807 19:54:40.027021 12910 external_mini_cluster.cc:1595] Killing /tmp/dist-test-taskviQnk1/build/asan/bin/kudu with pid 18195
2026-08-07T19:54:40Z chronyd exiting
[ OK ] ConnectToFollowerMasterTest.AuthnTokenVerifierHaveKeys/1 (5378 ms)
[----------] 2 tests from ConnectToFollowerMasterTest (10802 ms total)
[----------] Global test environment tear-down
[==========] 56 tests from 4 test suites ran. (406579 ms total)
[ PASSED ] 55 tests.
[ FAILED ] 1 test, listed below:
[ FAILED ] SecurityITest.TestJwtMiniCluster
1 FAILED TEST